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ABSTRACT 

This report of the California State Postsecondary 
Education Commission discusses standardized testing at the higher 
education level in California and is comprised of three parts. Part 1 
describes six tests related to undergraduate admission, placement, 
and financial assistance. Part 2 describes five tests required by 
graduate programs and professional schools for admission. For each of 
these tests, the report summarizes what the test is designed to 
measure, how it is formatted, and how it is used in California. The 
report also summarizes national and California participation and 
performance data by sex and major ethnic group for the last 5 years, 
to the extent this information is provided by the test sponsors. In 
addition to mean (average) test performance by group, the report 
reviews available data on the test's predictive validity and standard 
error of measurement that nave implications for appropriate test use. 
Part 3 reviews the relations between standardized testing and college 
admission in California and the role testing companies have, or can 
have, in expanding access for Hispanic, Black, and American Indian 
students. The report concludes by identifying three areas in which 
further efforts are needed in order for the Commission to respond 
more completely to the authorizing statute. Appendices contain State 
Senate Bill 1416 and test sponsor materials. Contains 43 references. 
(GLR) 
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Summary 



This is the fifth annual Commission re^'ort on standardized test- 
ing in California. Pax i One describes six tests related to under- 
graduate admission, placement, and financial assistance - the 
Preliminary Scholastic Aptitude Test (PSAT), the Scholastic Ap- 
titude Test (SAT), College Board AchieverAent Tests, the Ameri- 
can College Test (ACT), Advanced Placement Examinations, and 
the Test of English as a Foreign Language (toefl). 

Part Two describes five tests required by graduate programs 
and professional schools for admission - the Graduate Record 
Examinations (GRE), the Graduate Management Admission 
Test (GMAT), the Law School Admission Test (LSAT), the Medical 
College Admission Test (MCAT), and the California Basic Educa- 
tion Skills Tests (CBEST). 

For each of these tests, the report summarizes what the test is 
designed to measure, how it is formatted, and how it is used in 
California. As required by statute, the report summarizes na- 
tional cuid California participation tind performance data by sex 
and major ethnic group for the last five years, to the extent this 
information is provided by the test sponsors. In addition to 
mean (average) test performance by group, the report reviews 
available data on the test's predictive validity and standard er- 
ror of measurement that have implications for appropriate test 
use. 

Part Three of the report reviews the relations bt^tween standard- 
ized testing and college adioission in California and the role 
^ testing companies have or can have in expanding access for His- 
panic, Black, and American Indian students. The report con- 
cludes by identifying three areas in which further efforts are 
needed in order for the Commission to respond more completely 
to the authorizing statute: (1) the validity of admission require- 
ments, including standardized admission tests, at the State's 
public universities; (2) the factors that limit standardized ad- 
mission test participation among certain student subgroups; 
and (3) alternative strategies to involve testing companies in co- 
operative actions to expand access to college. 

The Commission adopted this report at its meeting on April 30, 
1990, on the recommendation of its Policy Evaluation Commit- 
tee. Additional copies of the report may be obtained from the 
Publication Office of the Commission at (916) 324-4991. Ques- 
tions about the substance of the report may be directed to Jean- 
ne Suhr Ludwigof the Commission staff at (916) 322-7987. 
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Introduction 



IN 1978, California became the first state to enact 
'*trath-in-testing'' or **test disclosure" legrlslation 
(Senate Bill 2006, Dunlap). That law, codified in 
Part 65 of the California Education Code, required 
sponsors of standardized admissions tests to file fi- 
nancial disclosure statements, copies of materials 
distributed to test-takers, and ^ropies of recent tests 
with corresponding answers with the California 
Postsecondary Education Commission, provided 
that the test was administered to at least 3,000 indi- 
viduals in California. This information then be- 
came public record, available to interested parties 
through the Commission's library. 

In 1984, Senate Bill 1785 (Torres) amended Part 65 
of the Education Code to require that sponsors of 
these tests also provide the Commission perfor- 
mance data that includes State and national aver- 
ages and standard deviations by sex and ethnic 
group as well as the most recent findings of studies 
of the predictive validity of the tests. The Commis- 
sion has published four reports on this information 
(1986, 1987,1988, and 1989). 

In 1989, Senate Bill 1416 (Torres) (reproduced in 
Appendix A on pages 33-36) revised the part of the 
Code that requires the Commission to report bienni- 
ally on student participation and performance and 
predictive validity data for these standardized tests 
to the Governor, the Legislature, the Regents of the 
University of California, Board of Governors of the 
Calilbmia Community Colleges, the Trustees of the 
California State University, and the Superinten- 
dent of Public Instruction. In addition, the Commis- 
sion must **present specific recommendations on (1) 
methods to remove the inappropriate obstacles that 
standardized college admissions tests may provide 
in precluding some students from obtaining regular 
admission to public colleges and universities and (2) 
strategies to involve the testing companies in coop- 
erative actions with schools, colleges, and universi- 
ties to expand access to college for Hispanic, Black, 
and American Indian students.'^ 

This report is the fifth in the Commission's series on 
standardized tests in California and its format and 
content serve as a transition from the previous an- 



nual reports to the more comprehensive biennial re- 
porting. 



Role of standardized tests 

Until the early 1900s, admission to most secondary 
and postsecondary educational institutions in 
America was reserved to certain social classes. Ad- 
mission was determined almost exclusively by fam- 
ily ties and other associations not related to aca- 
demic achievement or potential. As secondary edu- 
cation became more universal, institutions of high- 
er education - particularly land-grant colleges - 
sought a more objective, academically grounded ba- 
sis for making admission decisions. 

Standardized tests were developed to identify those 
who were best prepared, either by nature or train- 
ings to perform well in the roles of undergraduate or 
graduate students. Colleges and universities saw 
test results as a more objective basis for selecting 
students that were more directly related to aca- 
demic performance and potential than family ties, 
letters of recommendation, and personal interviows. 
They weie instituted as a mechanism for reducing 
the potential for bias in the selection decision. 

Two types of standardized tests developed 
achievement tests that were designed to measure 
student's knowledge in speciHc curricular areas 
such as English, mathematics, or science; and apti- 
tude tests that were designed to measure general 
verbal and quantitative abilities, either natural or 
acquired, that are believed to be related to subse* 
quent academic achievement. Currently, standard- 
ized examinations are major components of most ad- 
mission criteria at California's public universities 
at the undergraduate and graduate level. 

Considerable controversy surrounds the use of test 
results by higher education institutions and the im- 
pact on the higher education opportunities of cer- 
tain groups of students, prompting the implementa- 
tion of truth-in- testing legislation. While these 
laws have done little to resolve the controversies 
surrounding standardized examinations and their 
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use, the presentation of available data and review of 
key issues are fundamental to sound public policy 
review in thi» area. 



Organization of the report 

In compliance with the specification of the statutes, 
this 1990 report summarizes participation and per- 
formance data and test statistics for the major stan- 
dardized tests used for higher education admission 
or placement and taken by at least 3,000 individu- 
als in California. The report is organized into three 
parts. 

# Part One on pages 3-18 describes six tests related 
to undergraduate admission, placement and fi- 
nancial assistance - the Preliminary Scholastic 
Aptitude Test/National Merit Scholarship Quali- 
fying Test, the Scholastic Aptitude Test, College 
Board Achievement Tests, the American College 
Test, Advanced Placement Examinations, and 
the Test of English as a Foreign Language. 

# Part Two on pages 19-28 describes five tests re* 
quired by graduate programs or professional 
schools - the Graduate Record Examination, the 
Graduate Management Admission Test, the Law 
School Admission Test, the Medical College Ad- 
mission Test, and the California Basic Education 
Skill&Test. 

# Part Three on pages 29 34 presents a review of 
the relations of standardized testing to college 
admission in California and the role testi:.;g com- 
panies have or can have in expanding access for 
Hispanic^ Black, and American Indian students. 

For each test, the report summarizes what the test 
is designed to measure and how it is used in Califor- 
nia as well as the format of the test. Then the report 
presents California and national participation and 
performance data by sex and major ethnic group for 
the last five years, to the extent this information is 
provided by the test sponsors. In addition to mean 
(or average) test performance by group, the report 
reviews available data on the test's '^predictive va- 
lidity" and ^'standard error of measurement" that 
have implications for appropriate te3t use. 

Predictive validity 

The '^predictive validity" of a test is a measure of 
the relationship or correlation between the test re- 
sults and some other subsequent measure of student 
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behavior, most commonly first-year college or pro- 
gram grade-point average. If knowledge of test re- 
sults enabled one to predict grade-point averages 
with complete accuracy, the correlation would be 
perfect with a coefficient of 1, its maximum value. 
The correlation coefficient quantifies the amount of 
variation in the outcome results, such as grade- 
point average, that can be accounted for by the vari- 
ation in performance on the predicting activity or 
test. The percentage of variation thai can be ex- 
plained equals the correlation coefficient squared 
(multiplied times itself) and then multiplied by 100. 
In the case where the predictive validity (or correla- 
tion ) was 1, the predictor explained 100 percent of 
the variation in the outcome. If the predictive va- 
lidity was a .5 correlation, 25 percent of the vari- 
ation in the outcome result is explained by knowing 
the predictive measurement. 

Standard error of measurement 

Because no test is a perfect measure of knowledge in 
the areas tested, individuals would likely earn 
somewhat different scores if they took any test re- 
peatedly even assuming no change in their knowl- 
edg^e of the area. The mean difference in the scores 
that iadividuals would earn each time they took the 
test is known as the '^standard error of measure- 
ment" and can be estimated. When comparing 
scores of two individuals, the size of the difference 
between their score must be greater than the stan- 
dard error of measurement before one can conclude 
any real difference in ability as measured by that 
test exists between the two test takers. 

It is also important to recognize that the precision of 
any test is limited in part because it represents oniy 
a sample of questions that could be asked in the do- 
main of the test. Also, people perform at different 
levels at different times for reasons not related to 
the test or their skills, such as physical condition or 
motivation. 

• 

The financial disclosure information for 1988-89 
submitted by sponsors of the tests covered by this 
report appears in Appendix B beginning on page 39. 
All information submitted by these sponsors is avail- 
able to the public at the Commission's library, 1020 
Twelfth Street, Third Floor, Sacramento, California. 
Generally the library is open during regular work- 
ing hours - 8:30 a.m. to 5:00 p.m., Monday through 
Friday. Information requests may be directed to the 
Commission's librarian at (916) 322-8031. 
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Tests Used for Undergraduate Admission, 
Placement, and Financial Awards 



THIS PART of the report reviews the major nation- 
ally normed standardized test used for undergrad- 
uate admission, placement, and financial awards. 
For each test, the report identifies the nature of the 
test, what it is designed to measure, and how it is 
structured. It describes the current use of the test 
in California and presents data on participation and 
performance on the test by sex and major f^thnic 
group over the past five years along with major test 
statistics - standard error of measurement and pre- 
dictive validity. 

Because the focus of the enabling legislation was 
mBjor nationally normed admission tests, a whole 
category of tests, that technically fits the descrip- 
tion of tests in the statutes, has not been included in 
these reports. This category of tests is placement 
examinations administered by public colleges and 
universities to their entering students for the pur- 
pose of course placement. Major examples of these 
tests are the Subject A examination of the Universi- 
ty of California, the Elementary-Level Mathemat- 
ics (elm) test and the English Placement Test (EPT) 
ofthe State University, and the array of tests used 
by community colleges as part of their matricula- 
tion efforts. The Commission expects to include 
data on these examinations in its next testing re- 
port, and it will review their role in its forthcoming 
report on student retention. 



PreiimLiary Scholastic Aptitude Test/ 
National Merit Scholarship Qualifying 

Test (PSAT/NMSQT) 

The Preliminary Scholastic Aptitude Test is an ap- 
titude test designed to measure general verbal and 
mathematical abilities believed to be important for 
doing college work. The verbal section of the test 
consists of 65 multiple choice questions on ant- 
onyms, sentence completions, analogies, and read- 
ing comprehension. The first three verbal sections 
draw from four broad content areas - aesthetic or 
philosophical, practical affairs, scientific, and hu- 



man relations. The reading selections are taken 
from six areas: narrative or prose fiction, argumen- 
tative or polemical material, humanities, social 
studies, physical science, and biological science. 
The mathematics section consists of 33 regular mul- 
tiple choice questions and 17 quantitative compari- 
sons and covers content in the areas of arithmetic, 
algebra, and geometry. Test takers have 50 min- 
utes per section or one hour and 40 minutes to com- 
plete the test. 

Students receive a separate score ibr the verbal and 
math sections. Students' raw scores, which are the 
number of correct responses less a quarter or third 
of a point deduction for incorrect responses, are con- 
verted to PSAT scaled scores by a process known as 
'^equating*' which adjusts scores to account for mi- 
nor differences in the difficulty between various edi- 
tions or versions ofthe test. The scaled scores range 
from 20 to 80. 

In California, as nationally, the PSAT is the qualify- 
ing mechanism for the National Merit Scholars hip 
program, the National Achievement Scholarship 
Program for Black Students, and the National His- 
panic Scholarship Program. PSAT scores are con- 
verted to Selection Index scores by multiplying the 
verbal score by two and adding the math score. Ap- 
proximately 15,000 students nationally with the 
highest index scores are designated National Merit 
Scholarship Semifinalists. Allocation of semifinal- 
ist slots is determined for each state based on that 
state's percentage of the nation's total number of 
graduating seniors. Thus, the index score required 
to qualify for Semifinalist status varies among the 
states. Approximately 90 percent of the semifinal- 
ists are expected to complete the supplemental re- 
quirements necessary to qualify as Finalist. From 
this pool of approximately 13,500 students national- 
ly, about 6,000 scholarships are awarded. Postsec- 
ondary education institutions can also receive direc- 
tory information released by PSAT test takers for the 
distribution of recruitment and informational mate- 
rials. 
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The PSAf is essentially a short version of the Scho* 
lastic Aptitude Test and as such can serve as a prac* 
tice for that examination. Students receive compre- 
hensive reports of their performance on the PSAT de- 
tailing questions answered correctly and incorrect- 
ly. Students and their counselors can use this mate- 
rial to focus SAT preparation activities. Counselors 
and other school personnel can use aggregate PSAT 
results as a component in their curriculum review. 

Participation and performance 

Nationally, 1,118,761 juniors took the PSAT in 1988- 
89, a 7 percent decrease from 1987-88. In Califor- 
nia, 97,118 juniors completed the test for a 2 percent 
decrease from last year. A decline in the number of 
White juniors taking the test not only accounted for 
the overall decline but also offset increases in par* 
ticipation of students from all other ethnic sub- 
groups. Display 1 below presents participation 
rates and mean PSAT verbal and math scores nation- 
ally and in California for the past five years. 

In 1988-89, the mean verbal score nationally was 
40.7 with a standard deviation of 10.2 and the mean 
math score was 45.6 with a standard deviation of 
11.1. In California, the mean verbal score was 40.1 
with a standard deviation of 10.8 and in math the 
mean score was 45.9 with a standard deviation of 
11.5. California test takers have consistently scored 
slightly above the national average on the math 
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DISPLAY 1 Mean PSAT Verbal and Math 
Scores Nationally and in California, 1985-89 
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section while their verbal scores have fallen below 
the national average. Over the last five years, Cali- 
fornia and national mean math scores increased 
while verbal scores declined somewhat. Displays 2 
and 3 on the opposite page show the participation 
and performance on the PSAT natior ally and in Cali- 
fornia, by sex and ethnic group since 1985. 

Displays 4 and 5 on page 6 shows the participation 
and performance of men and women nationally and 
in California on the PSAT The majority of PSAT test 
takers are women and their representation has in- 
creased slightly over the last five years. The pat- 
tern of increases in math scores and decreases in 
verbal scores is consistent with the overall pattern, 
with the most marked decreases in verbal scores ap- 
pearing among California male test takers. Wom- 
en, both nationally and in California, have im- 
proved their mean math scores more than men. 

Substantial differences in mean verbal and math 
scores exist among test takers from various ethnic 
groups in California, as Displays 6 and 7 on page 6 
illustrate. While mean math scores increased for 
all ethnic groupp, the size of the increase was great- 
est for American Indian and Hispanic test takers. 
Similarly, while the mean verbal scores declined for 
Asian and Hispanic test takers, mean verbal scores 
for White and American Indian test takers in- 
creased. 

The standard error of rn^^asurement of the national 
PSAT verbal score is 3.6 points while for math scor 
it is 3.6 points. Thus, if an individual took the PSAT 
many times, nine times out o( ten his or her score 
could fluctuate by as much as ± 7 points on the ver- 
bal and math sections without indicating any true 
change in ability. Thus, small differences in report- 
ed scores in this range do not indicate any real dif- 
ferences in the ability of stud«%nts but are prob^.hly 
attributable to errors of mea;^arement inhev^iwl ? • 
the test. 

Predictive validity 

Because, by design, the FSAT is simply a shon ver- 
sion of the SAT, the discussion of predictive validity 
accompanying the PSaT materials focused exclu- 
sively on the predictive validity of thp SAT, This in- 
formation is sui^^marized in a subsequent sectkm. 
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DISPLAY 2 Participation of High School Juniors Taking the PSAT/NMSQT Nationally and in 
California by Sex and Ethnicity, 1985 to 1988 
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20.2 


Black 


5,019 


5.287 


5^39 


5,707 


5,771 


5.7 


5.7 


5.7 


5.9 


6.1 


American Indian 


587 


694 


747 


♦ 677 


716 


0.7 


0.8 


0.8 


0.7 


0.8 


Hispanic/Latino 


9,080 


12.157 


13,132 


14.182 


15.071 


10,4 


13.2 


13.5 


14.6 


15.8 


Other 


3,270 


1,681 


1,941 


2,124 


2.203 


3.7 


1.8 


2.0 


2.2 


2.3 


White 


57,223 


583S4 


59.207 


56,870 


52334 


65.3 


63.1 


61.0 


58.5 


54.9 


No Response 


7335 


7,082 


7.734 


2,034 


1,820 


8.2 


7,1 


7.4 


2.0 


1.9 



Sourte: PSAT/KMsqfT Summary Reporta, 1984-86 to 1988-89. 



DISPLAY 3 Mean Scores of High School Juniors on the PSAT/NMSQT Nationally and in California 
by Sex and Ethnicity, 1984 to 1988 



Natioiial 



California 





1984-85 1985-86 1986-87 1967-88 1988-89 


1984^ 


1985-86 


1986-87 


1987-88 1988-89 


Vcibal 






















Total 


41.0 


40.9 


40,9 


40.4 


40.7 


AOS 


405 


40.4 


40.0 


^0.1 


Men 




41J 


41.6 


41.1 


41.1 


41.0 


41.2 


41.1 


40.1 


40.4 


Women 




40.3 


40.3 


39.8 


40,4 


40,1 


40.0 


39.8 


39.4 


39.7 


Asian 












38.4 


385 


37.9 


37.8 


38.2 


Black 












34.1 


34.2 


34.4 


33.9 


34.4 


American Indian 












38,7 


38.8 


38.8 


38.6 


39.0 


Hispanic/Latino 












35.4 


35.4 


35.1 


34.9 


35.0 


Other 












36.6 


missing 


missing 


38.2 


38.3 


White 












42.7 


42,7 


42.8 


42.7 


42.9 


Mathematics 






















Total 


44.2 


45.0 


45.0 


45.0 


45.6 


44.6 


45.1 


45,4 


45.6 


45.9 


Men 


46.5 


47.3 


47.2 


47.3 


47.7 


47.1 


47.7 


47.8 


48.1 


48.2 


Women 


42.3 


43.2 


43.1 


43.2 


44.0 


42.5 


43.3 


43.4 


43.6 


44.1 


Asian 












47.7 


48.7 


48.4 


48.6 


49.1 


Black 












36.4 


36.9 


37.5 


37.2 


37.8 


American Indian 












415 


42.2 


42.3 


42.5 


43.4 


Hispanic/Latino 












38.6 


39.1 


39.5 


39.8 


40.5 


Other 


« 










40.7 


missing 


missing 


43.4 


44.3 


White 












45.9 


46.8 


46.7 


47.2 


47.4 



Source: psat/nmsqt Summary Roporta, 1986*86 to 1988-89, 



DISPLAY 4 Mean PS AT Math Scores 
Nationally and in California for Men 
and Women, 1985-89 
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DISPLAY 6 Mean PSAT Math Scores 
in California by Ethnicity, 1985-89 
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Source: California Postsecondary Education Commission. 



DISPLAY 5 Mean PSAT Verbal Scores 
Nationally and in California for Men and 
Women, 1985-89 
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DISPLAY 7 Mean PSAT Verbal Scores 
in California by Ethnicity, 1985-89 
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Scholastic Aptitude Test 

The Scholastic Aptitude Test (SAT) is a slightly 
longer and more difHcult version of the PSAT and as 
such is an aptitude test designed to measure devel- 
oped verbal and mathematical reasoning abilities 
related to academic performance in college, as indi- 
cated in the predictive validity section below. The 
two and one-half hour test includes 85 multiple 
choice questions in the verbal sections and 60 ques- 
tions in the mathematics sections and the structure 
of the questions and the content areas covered are 
the same as on the PSAT. Test takers receive a ver- 



bal score and a math score that range from 200 to 
800. 

Because the subject .natter of high school courses as 
well as grading standards vary widely, the tests 
have been developed to provide a common standard 
against which students can be compared. It iS in- 
tended to supplement the secondary school record 
and other information about the student in assess- 
ing readiness for college-level work (ATP Guide for 
High Schools and Colleges). 

SAT scores are components of the adn.ission criteria 
for the University of California and the California 
State University. At the University, all applicants 
are required to submit SAT (or ACT, described below) 



results. However, for applicants who have complet- 
ed the prescribed University preparatory curricu- 
lum with a high school grade*^point average above 
3.3, test scores are used for placement purposes 
only. To be eligible for regular admission, appli- 
cants with grade-point averages between 2.78 and 
3.3 in the prescribed curriculum must achieve a 
minimum total SAT score (or composite ACT score) as 
specified by the University's Eligibility Index* 

The State University also requires applicants to 
complete a prescribed pattern of high school courses 
but an applicant's grade-point average is computed 
on the basis of all course work except physical edu- 
cation and military science. The State University 
does not require students with high school grade- 
point averages above 3.0 to submit test results. For 
applicants with grade-point averages between 2.0 
and 3.0, the student must achieve a minimum total 
SAT score (or composite ACT score) as specified by 
the State University's Eligibility Index to be eligi- 
ble for regular admission. (For a more comprehen- 
sive review of segmental freshman admission crite- 
ria^ refer to the Commission's March 1988 report, 



The Eligibility of California's 1986 High School 
G( actuates for Admission to its Public Universities,) 

Participation and performance 

In 1988-89, 1,088,223 students took the SAT nation- 
ally, ii 4 percent decrease over 1987-88. In Califor- 
nia, 115,562 students completed the SAT, represent- 
ing a negative change of 3.5 percent from 1987*88. 
Because SAT test takers include juniors and seniors 
and even some sophomores, it is difficult to compute 
participation rates or changes in test participation 
compared to changes in the size of the high school 
population. Displays 8 and 9 below and on page 8 
present the participation and performance data on 
the SAT nationally and in California since 198d. 

The national mean verbal SAT score in 1988-89 was 
427 with a standard deviation of 111 while the 
mean math SAT score was 476 with a standard devi- 
ation of 121, showing virtually no change since 
1987-88, as illustrated by Display 10 on page 8. In 
California, the mean verbal score was 422 with a 
standard deviation of 113, down somewhat from the 



DISPLAY 8 Participation in the SAT Nationally and in California by Sex and Ethnicity, 1985 to 1989 



Category 






Number 










Percent 








19ms 


1985^ 


1986*7 


1967-88 


1988-89 


1984-85 


198S-46 


1986*7 


1987*8 


1988-89 


National 






















Toul 


1,0S2451 1,075454 1,080.426 1.134,364 1,088,223 












Men 


507,843 


517,262 


520,326 


544,065 


521,229 


48.3 


48.1 


48.2 


48.0 


47.9 


Women 


5444M)8 


558,292 


560,100 


590,299 


566,994 


51.7 


51.9 


51.8 


52.0 


52.1 


Asian 


42,637 


NA 


58,216 


64,102 


68,254 


4.1 


N.A. 


5.4 


5.7 


6.3 


Black 


79,556 


NA. 


88,037 


97,483 


96,615 


7.6 


N.A. 


8.1 


8.6 


8.9 


American Indian 


4,642 


NA. 


10,107 


12,330 


18,005 


0.4 


N.A. 


0,9 


1.1 


1.7 


Hicpanic/Latino 


30,603 


NA. 


49,913 


54,432 


57,864 


2.9 


NA 


4.6 


4.8 


5.3 


Other 


21,555 


NA 


13,102 


14,094 


13,454 


2.0 


N.A. 


1.2 


1.2 


1.2 


White 


715,773 


NA 


788,613 


813,116 


752,257 


68.0 


NA 


73.0 


71.7 


69.1 


No Response 


157,585 


NA 


72,438 


78,807 


81,774 


15.0 


NA 


6.7 


6.9 


74 


California 






















Total 


113,960 


117,723 


117,198 


119,784 


115452 












Men 


54,495 


56,131 


56,148 


57,271 


55,312 


47.8 


47.7 


47,9 


47.8 


47.9 


Women 


59,465 


61492 


61,050 


62413 


60,240 


52.2 


52.3 


52.1 


52,2 


52.1 


Asian 


14,822 


NA. 


19,322 


21,026 


21,268 


13.0 


N.A. 


16.5 


17.6 


18,4 


Black 


6,435 


NA 


7,129 


7,247 


7,294 


5.6 


N.A. 


6,1 


6.1 


6,3 


American Indian 


759 


NA 


1,347 


1477 


i,m 


0.7 


N.A. 


1.1 


1,3 


1.6 


Hispanic/Latino 


9,437 


NA. 


13,395 


14,220 


15466 


8.3 


N.A. 


11,4 


11.9 


134 


Other 


3,737 


NA. 


2372 


2,741 


2,761 


3.3 


N.A. 


2,0 


2.3 


2.4 


White 


61,650 


NA. 


67,114 


65,647 


58,851 


54.1 


N.A. 


57,3 


54.8 


50,9 


No Response 


17,120 


NA. 


6419 


7426 


7,920 


15,0 


N.A. 


5,6 


6,1 


6,9 



NA « Not Available. 



Source: Profiles of sat and Achievement Teat Taltera, National Roporta and California Reports, 1986-89. 
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DISPLAY 9 Mean Scores of Test Takers on the SAT Nationally and in California by Sex and 
Ethnicity, 1985 to 1989 



National 



California 





1984^ 


1965^ 


1986^7 


1987-88 


1988^ 


1984-85 


1985-86 


1986-87 


1987-88 


1988-89 


Veibal 






















Touil 


431 


431 


430 


428 


427 


424 


423 


424 


424 


422 


Men 




AVI 

'♦37 


Alt 


4aj 


434 


AW 




din 










426 




422 


421 


419 


418 


418 


417 


416 


Aiuin 


AfiA 


IN .A* 


♦HO 


ATM 


•HTr 




NI A 


JO / 


jVU 








NI A 


151 




351 


355 


NA 


359 


362 


363 


/\iiicriC9ii inuian 




N A 




3Q3 


384 


408 


NA 


408 


408 


401 






N A 


378 


378 


380 


381 


NA 


377 


378 


378 


Other 


391 




405 


410 


414 


391 


NA 


419 


425 


426 


▼T lUlC 




N A 


447 


445 


446 


454 


NA 


453 


453 


455 


Mathemalics 






















Total 


475 


475 


476 


476 


476 


480 


481 


482 


484 


484 


Men 


499 


501 


500 


498 


500 


506 


508 


508 


508 


510 


Women 


456 


451 


453 


455 


454 


452 


456 


458 


461 


461 


Asian 


S18 


NA 


521 


522 


525 


505 


NA 


508 


509 


512 


Black 


376 


NA 


377 


384 


386 


386 


NA 


388 


392 


397 


American Indian 


428 


NA 


432 


435 


428 


445 


NA 


456 


457 


448 


Hispanic/Latino 


424 


NA 


422 


424 


427 


422 


NA 


423 


426 


428 


Other 


452 


NA 


455 


460 


467 


452 


NA. 


476 


481 


486 


White 


490 


NA. 


489 


490 


491 


497 


NA. 


499 


501 


5(M 



N A « Not available due to change in SDQ form. 

Source: Profiles of SAT and Achievement Test Taken, National Reports and California Reports, 1985 to 1989. 



DISPLAY 10 Mean SAT Verbal and Math 
Scores Nationally and in California, 1985-89 
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Source: Califorma Postsecondary Education CommiBSion. 

previous year, while the mean math score of 484 
with a standard deviation of 121 was unchanged 
from the previous year. Mean math scores national* 
ly have been very stable over this period while Cali- 
fornia mean math scores have risen slightly. At the 
same time, mean verbal scores in California have 
been quite stable until the current year when they 
dropped 2 points while nationally the mean verbal 
scores have declined slightly over the entire period 



Mean math test results among Californians contin* 
ue to exceed the national average while mean ver- 
bal scores among Californians remain somewhat 
below the national average. However, the gap be- 
tween the national and California mean verbal 
scores has narrowed somewhat. 

Examination of differential trends in math and ver- 
bal scores for men and women as presented in Dis- 
plays 11 and 12 on page 9 highlight the sources of 
the overall trends noted above. Improvement in 
math scores among California women dispropor- 
tionately accounted for the overall improvement in 
the mean math score in California. Conversely, the 
declines in mean verbal scores for women accounted 
for most of the decline in the overall verbal mean 
nationally while the recent drop in California scores 
occurred at a similar level for men and women* 

As in the case of the FSAT results, major differences 
exist among California's ethnic groups in their 
mean scores on the verbal and math sections of the 
SAT, illustrated by Displays 13 and 14 on page 9. 
Mean math performance improved for all groups 
since 1985, with Black test takers showing the 
greatest average score gain. Changes in achieve- 
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DISPLAY U Mean SAT Math Scores 
Nationally and in California for Men and 
Women, 1985-89 
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DISPLAY 12 Mean SAT Verbal Scores 
Nationally and in California for Men and 
Women, 1985-89 
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ment on the verbal section were mixed, with Black 
and Asian test takers showing some improvement 
in their mean group scores while the mean scores 
Csjc Hispanic and American Indian test takers de- 
clined. The gap between the scores of the highest 
and lowest performing groups has narrowed slight- 
ly in recent years, but it remains substantial. 

The standard error of measurement for the SAT ver- 
bal and math sections historically has been approxi- 
mately 36 points on each section. If an individual 
were to take the SAT repeatedly, even assuming no 
change in the individual's knowledge or abilities, 
nine times out of ten their total score could fluctu* 
ate by as much as 70 points. The College Board ad- 
vises that the difference between two scores is not 
significant until it exceeds 1.5 times the standard 




DISPLAY 13 Mean SAT Math Scores 
in California by Ethnicity, 1985-89* 
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DISPLAY 14 Mean SAT Verbal Scores 
in California by Ethnicity, 1985-89* ' 
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error of measurement. Thus, differences between 
individuals' scores on each section of less than 70 
probably do not indicate any real differences in 
their ability as measured by this test. 

Predictive validity 

Predictive validity indicates a test's effectiveness in 
predicting a student's performance. Studies of the 
predictive validity of the SAT tests compare the pre- 



1 



dieting variables 3Uch as S/iT scores and high school 
grade-point averages with freshman year grade* 
point averages The ATP Guide for High Schools and 
Colleges summarizes predictive validity studies for 
685 colleges and universities which examined the 
correlation between the grade-point averages of 
their freshman class and their SAT scores and high 
school grade-point averages. The median predictive 
validity correlation for high school grades alone was 
.48, that is half of the studies yielded predictive va- 
lidity correlations of less than .48 and half showed 
predictive validity correlations of more than .48. 
The median predictive validity correlation for SAT 
scores alone was .42 while the correlation for grades 
end tests combined was .55. Thus, high school 
grades and SAT scores explain about 30 percent of 
the variation in freshman grade-point averages. 
High school grades alone explain about 23 percent 
while SAT scores alone explain about 18 percent of 
the variation. SAT scores when used in conjunction 
with high school grades provide a somewhat better 
indicator of freshman grades than would high 
school grades alone. The summary data show that 
this relation holds for men and women separately 
but no summary information was available in that 
document about the relative predictive validity for 
each ethnic group. 

The College Board's Technical Handbook for the 
Scholastic Aptitude Test and Achievement Tests 
provides more detailed information about the pre- 
dictive validity of the SAT. It orgar \zes the flndings 
of the 686 studies into more homogeneous categor- 
ies. The predictive validity correlation for four-year 
public institutions of the SAT alone is .38, for high 
school grades alone is .44, and combined SAT and 
grades is .51. Data from studies in the western re- 
gion show the validity coefficient for SAT alone of 
.42, for high school grades alone of .47, and for 
grades and SAT combined of .56. 

This document also summarizes the finding on pre- 
dictive validity of SAT scores and high school grades 
for freshman grade-point averages for Black fresh- 
men at 1 1 predominantly White institutions. No in- 
formation on regional location or institutional con- 
trol type is given. The SAT alone does not predict as 
well for Black students in predominantly White in- 
stitutions as for other students - predictive validity 
coefificient of the SAT alone for Black students being 
.30 compared to .38 for other students. However, 
high school grades provide even less information 



about freshman year performance of Black students 
with a predictive validity coefficient of .26 com- 
pared to .42 for other students. The predictive va- 
lidity coefficient for high school grades and SAT 
scores combined for Black freshmen is .37 compared 
to .49 for other students. These standard measures 
provide less information about variability of fresh- 
man grades for Black students than for other stu- 
dents. 

In four studies that examined the predictive valid- 
ity of SAT scores and grades for Hispanic freshmen, 
the results were similar to those for Black students. 
While no specific predictive validity coefficients 
were presented, the report states (p. 159): 

In terms of predictive validity, correlations 
with freshman grade point averages were gen- 
erally lower for Hispanic students for both SAT 
scores and high school record. The proportional 
contribution of SAT verbal score to predictive ef- 
fectiveness was 15 percent lower for Hispanic 
students than other students; the offsetting in- 
creases were 10 percent for SAT mathematical 
score and 5 percent for high school record. 



College Board Achievement Tests 

The College Board Achievement Tests are curric- 
ular-based achievement tests designed to measure 
knowledge and the ability to apply that knowledge 
in 14 specific subject areas. While these tests are 
curriculum based, they are independent of particu- 
lar textbooks or methods of instruction and are de- 
signed to assess outcomes of courses that students 
have taken recently. Each test is one hour and has 
multiple choice format except the December Eng- 
lish Composition Test that includes a 20 minute es- 
say. Achievement Test scores range from 200 to 
800. 

Scores from three College Board Achievement Tests 
are components of the admission requirements for 
the University of California. Applicants to the Uni- 
versity are required to submit scores from the Eng- 
lish Composition Test, the Mathematics I or Math- 
ematics II Tests, and a score from English Litera- 
ture, foreign languages, science, or social studies. 
No minimum score is required as part of the regular 
admission process. University officials state that 
scores are used for student advisement on place- 
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ment in certain subject areas. Students may also 
achieve eligibility for admission to the University 
by test scores alone if his/her combined SAT score is 
at least 1100 (or composite ACT is 26) and their total 
score on the three Achievement Tests is 1650 or 
higher, with a minimum u:^ore of 500 on each test. 
Achievement Test scores are not an admission re- 
quirement or option at the California State Univer- 
sity. 

Participation and performance 

Display 15 below shows the number of test takers 
and mean scores on the English Composition test 
and the two mathematics tests for California and 
the nation in the last five years. California stu- 
dents comprise over 20 percent of all Achievement 
Test takers nationally. While participation nation- 
ally in the Achievement Tests has increased slight- 
ly over the past five years, participation in Califor- 
nia has increased substantially - 18 percent in Eng- 
lish Composition, 19 percent in Math I, and 33 per^ 
cent in Math II. 

California Achievement Test takers have consis- 
tently earned lower scores in all areas except Span- 
ish. Nationally, English Composition scores h^ ve 
been quite stable while they have declined in Cali- 
fornia. In mathematics, mean scores on Math Lev- 
els I and II have increased both nationally and in 
California with California mean scores increasing 
somewhat more than the national means. Data on 
differential participation and performance on 



Achievement Tests for men and women and among 
members of various ethnic s ubgroups were not 
available. 

Historical information on the standard errors of 
measurement for Achievement Tests is presented in 
The College Board Technical Handbook for the 
Scholastic Aptitude Test and Achievement Tests. 
The standard error of measurement for the English 
Composition test is ± 29.0 points, tor the Math I test 
± 33.6 points, and for the Math II test ± 31.9 points. 

Predictive validity 

The Technical Handbook summarizes the findings 
of Achievement Test validity studies conducted be- 
tween 1964 and 1981. In these studies, the average 
correlation of Achievement Test scores with fresh- 
man grade-point averages was 37 However, 
Achievement Test results add very little to the pre- 
dictive information provided by the combination of 
SAT scores and high school grades. The combination 
of SAT scores and grades have a mean correlation of 
.52 with freshman grades; the correlation increases 
to .55 when Achievement Test results are added. 



AmeHcan College Test 

The American College Assessment Program con- 
sists of four timed achievement tests in English Us- 
age, Mathematics Usage, Social Studies Reading, 



DISPLAY 15 Participation and Mean Achievement Test Scores in English Composition, 

Mathematics Level /» and Mathematics Level II in the SAT Nationally and in 
California, 1985 to 1989 
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i9as 


1966 


1987 


1988 


1989 


1985 


1986 


1987 
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English Compodtion 






















National 


188,811 


192,498 


190,051 


206,515 


196352 


523 


522 


524 


521 


523 


California 


38,122 


39,563 


43,038 


45,624 


45,040 


494 


496 


496 


490 


491 


Mathematics Levct I 






















National 


148,254 


149^ 


153,781 


158,779 


150,460 


540 


541 


548 


549 


548 


California 


31,138 


32,087 


35331 


37,520 


37,116 


515 


518 


525 


530 


525 


Mathcnutics Level 11 






















National 


45390 


50,261 


54,09:> 


56,553 


55,681 


658 


660 


662 


664 


666 


California 


9,047 


10,079 


11,100 


11,753 


12,008 


643 


646 


646 


6l51 


652 



Source: College Board, '^National and California Reports College-Bound Seniors, 1985 to 1988/ 




11 



and Natural Science Reading. The four tests are 
curricular based and are designed to abbess conterif- 
specific skills developed over the students' time in 
high school. The total test time is two and one-half 
hours. Raw scores are converted to standard scores 
on a scale from 1 to 36 for each test. The test taker 
receives scores in each area and a composite score 
that is the arithmetic average of the four area 
scores. 

As indicated above, ACT composite scores can be 
used to fulfill the examination requirement for ad- 
mission to the University of California and the Cali- 
fornia State University as specified by each seg- 
ment's Eligibility Index. ACT assessment materials 
may also be used for placement and counseling pur- 
poses by the universities. 

The American College Test Program also adminis- 
ters a Preliminary ACT which is designed to be a 
tenth grade academic assessment and guidance 
tool. In 1989, 8,426 California students took the P< 
ACT. Commission staff will begin including compre- 
hensive P-ACT information in its 1992 report. 



PcTticipatioix and performance 

Nationally, 855,17. ^.udents took the ACT in test 
y^ar 1988-89, a 1.5 percent increase over the pre- 
vious year. While California's 17,542 ACT test tak- 
ers represent only 2 percent of the national group, 
participation in the ACT in California increased 16 
percent over the previous year. Display 16 below 
presents the participation and performance data on 
the ACT, nationally and in California since 1985. 

The mean composite ACT score nationally in 1989 
was 18.6, a 0.2 point drop from 1988 and in Califor- 
nia the mean composite ACT score in 1989 was also 
18.6, a 0.5 point decline. The mean scores on the 
subject area test nationally were as follows: 18.4 in 
English, 17.1 in Mathematics, 17.2 in Social Sci- 
ence, and 21.2 in Natural Science. In California, 
the mean scores were 18.0 in English, 18.3 in Math- 
ematics, 17.1 in Social Science, and 20.6 in Natural 
Science. While California and national ACT compos- 
ite scores are virtually identical, some interesting 
differences in the subject area test results persist. 
California test takers continue to achieve above the 



DISPLAY 16 Mean and Composite Scores and Participation of Test Takers on the ACT Nationally 
and in California by Sex and Ethnicity, 1985 to 1989 



Category Nationai California 





1985 


1986 


1987 


1988 


1989 


1985 


1986 


1987 


1988 


1989 


Compodte Score 






















Total 


18.6 


18.8 


18.7 


18.8 


186 


19.3 


19i 


19.1 


19.1 


18.6 


M<n 


19.4 


19.6 


19i 


19.6 


19.3 


20i 


20.4 


20.1 


20.1 


19.4 


Women 


17.9 


18.1 


18.1 


18.1 


18.0 


18.4 


18.8 


18.3 


18.4 


18.0 


Asian 


19.2 


19.6 


19.8 


19.8 


19.9 


19.6 


19.9 


20.1 


19.7 


19.9 


Black 


13.0 


13.0 


13.4 


13.6 


13.6 


13.9 


14.1 


14.4 


14.1 


14.2 


American Indian 


14.4 


14.4 


14.6 


14.8 


14.7 


16.0 


16i 


16.3 


18.3 


17.2 


Hispanic/Latino 


15.1 


15.6 


15.8 


16.0 


15.9 


16.3 


16.3 


16.2 


16.2 


15.2 


White 


19.9 


19.9 


19.7 


19.5 


19.4 


20.3 


20.6 


20.2 


20.3 


20.2 


Participation 






















Total 


738,836 


729.606 


777,444 


842,322 


855,171 


10,658 


11,377 


13,803 


15,104 


17342 


Men 


338,668 


334,126 


356,704 


385,475 


391,377 


4,764 


5,119 


6,289 


6,733 


7.757 


Women 


400,168 


395,480 


420,740 


456,847 


463,794 


5,894 


6,258 


7314 


8,371 


9.785 


Asian 


10,926 


11,747 


13358 


15,432 


17,301 


897 


1,157 


1,401 


1.703 


1.951 


Black 


58326 


58,275 


61,129 


68,781 


73,461 


650 


729 


922 


1,151 


1,337 


American Indian 


6,779 


6,632 


7,247 


8,003 


8,995 


108 


116 


144 


144 


178 


Hispanic/Latino 


22361 


22390 


24,612 


27,878 


31,988 


715 


964 


1,353 


1.653 


2,454 


White 


586,301 


571,956 


600,329 


640,027 


649,923 


7,301 


7,297 


8,444 


8,752 


9,433 


No Response 


23,785 


23.016 


25,375 


27,088 


27.292 


987 


1,114 


1339 


1.701 


2,189 



Sources: American College TcsU "Executive Summary California ACT Assessment Results", 1989, 
and Trend Tables for ACT-Tested Students - California", 1989. 



national average in mathematics and below the na- 
tional average in natural sciences. Display 17 pre- 
sents the trends in ACT mean composite scores na- 
tionally and in California since 1985. At the begin- 
ning of this rjeriod, che mean composite score for 
California test takers was considerably above the 
national mean score. However, over this period, 
Californians' average performance declined such 
that in 1989 national and State mean composite 
scores were equal. The subject area test scores in 
which California test takers showed the greatest de- 
clines were social science and natural science. 



DISPLAY 17 National and California ACT 
Composite Score Means, 1985-89 
20.0 T 
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Source: California Postaecondary Education Commission. 



As illustrated in Display 18 at the right, mean per- 
formance on the ACT for women both nationally and 
in California is lower than that of men. While the 
tests scores for both men and women contributed to 
the overall decline in California scores* the mean 
composite score for men declined by twice as many 
points as did that of w jmen. This relative decline in 
performance held true in all subject area tests as 
welL 

As was the case for other standardized tests already 
presented, marked differences in mean composite 
test scores exist among ACT test takers from various 
ethnic groups in California as shown in Display 19. 
The most noticeable trend occurred for American 
Indian test takers. Between 1985 and 1987, their 
composite scores were very stable and then in 1988 
it increases two full points. In the current year, 
their mean score fell one point. The causes of these 
changes cannot be determined from the available 
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DISPLAY 18 National and California ACT 
Mean Composite Scores for Men and Women, 
1985^89 
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Source: California Poatsecondary Education Commission. 



DISPLAY 19 California ACT Composite Mean 
Score by Ethnicity, 1985-89 
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Source: California Poatsecondary Education Commission. 



data. The number of American Indian test takers in 
California did not change very much during this pe- 
riod. However, because there are so few American 
Indians participating in this test (only 178 in 1988), 
the influence of individual test takers* performance 
on the mean composite score is greater than is the 
case for larger subgroups. Since 1985, mean com* 
posite ACT scores for Asian and Black test takers in 
California have increased slightly (.3) while test 
scores for White test takers have declined slightly 
(. 1). Mean composite scores for Hispanic test takers, 
have declined by nearly one full point (.9). During 
this same period, Hispanic participation on the ACT 



has tripled. The decline in the composite score for 
Hispanic test takers reflects similar declines in 
their scores on the English, Social Science, and Nat- 
ural Scii'nce test; their sc ^es on the Math test de- 
clined only slightly over this period. 

Analysis of students' performance on the ACT be- 
tween October 1983 and June 1986 yielded a mean 
standard error of measurement for the composite 
score of 1.2 points. Thus, if the same individual 
with no change in knowledge took the ACT repeated- 
ly, nine times out of ten his or her true score could 
vary by as much as ±2.4 points. This known mea- 
surement error is one of the reasons why test scores 
should not be the sole basis for selection between 
students with comparable course work and achieve- 
ment but who have ACT score differences in this 
range. 

Predictive validity 

The ACT Assessment Program Technical Manual 
presents predictive validity findings based on a 
study that included data from 510 colleges. The 
study examined the relationship or correlation of 
first semester freshman grades with the four ACT 
subject area test scores and high school grade-point 
averages. The median predictive validity correla- 
tion of high school grades alone with first semester 
freshman grades was .44 while the correlation of 
the four test scores was .48. High school grades and 
test scores combined have a predictive validity cor- 
relation of .55. Thus, ACT scores, when used *n con- 
junction with high school grades, explain as much of 
the variation in first semester freshman grades as 
do SAT scores and high school grades in explaining 
freshman-year grades. The level of predictive valid- 
ity of the ACT scores and high school grades hold for 
men and women separately but specific validity cor- 
relations for various ethnic subgroups are not in- 
cluded in this report. 

A 1981 ACT Research Bulletin described a study of 
differential predictive validity for students from dif- 
ferent ethnic subgroups using data from 271 insti- 
tutions. The Bulletin presented the predictive cor- 
relations between freshman grades and the combi 
nation of high school grades and ACT test scores for 
Black test takers as .48, .56 for Hispanic test takers, 
and .56 for White test takers. 
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Advanced Placement Examinations 

Advanced Placement Examin itions are achieve- 
ment tests offered in 16 subject areas and are de- 
signed to assess students' mastery of advanced 
placement course work, for which the College Board 
provides the high schools with the curricular guide- 
lines and materials, and the final examinations are 
designed and administered by the Educational Test- 
ing Service. The format and duration of the exami- 
nations varies by the nature of the subject area but 
generally they include a multiple choice portion and 
a free response portion and are two to three hours in 
length. Each test yields a score between 1 d o rec- 
ommendation) and 5 (extremely well qualified). 
About 30 percent of the nation's high schools offer 
college-level instruction in the form of advanced 
placement classes. In California, about 874 public 
and private high schools offer advanced placement 
courses. 

Most of Califoraia's public and private accredited 
universities award either academic credit, ad- 
vanced placement, or course waivers to students re- 
cei dng a grade of 3 or better on any Advanced 
Placement Examination. A full summary of partici- 
pation and performance on Advanced Placement 
Examinations natiot^ally and in California in 1989 
appears in Appendix B. Display 20 on page 15 pre- 
sents the participation and performance on the six 
examinations taken by at least 3,000 California stu- 
dents in 1986 and 1989. The subject areas are 
American History, Biology, English Language and 
Composition, English Literature and Composition, 
Calculus A/B, and Spanish Language. 

Participation and performance 

Participation in Advanced Placement examinations 
has grown substantially over the past five years. 
Nationally, 455,996 Advanced Placement examina- 
tions were taken in 1988-89, a 8.8 percent increase 
from last year and a 64 percent increase over 1985. 
In California, 78,379 examinations were taken, an 
11.8 percent increase over last year and a 82 per- 
cent increase in the last five years. Of the six sub- 
ject areas in which the Icu^gest number of examina- 
tions were completed, the increase in national par- 
ticipation in calculus was disproportionate and in 
California, a disproportionately large increase in 
participation also occurred In Spanish. In spite of 



DISPLAY 20 Participation and Mean Score on Selected Advanced Place'^.ent Examinations in 
California in 1985 and 1989 



1985 

Category 



American History 



Biology English Language English Literature 



Calculus 



Spanish 



National 
California 
Men 

Women 

Asian 
Black 

Amcr^|can J^J^^^^^^^, 



Hispanic/Latino 



Other 

iililllB^ 

White 

No response 



Number 


Score 


Number 


Score 


Number 


Score 


Number 


Score 


58,684 


3.07 


22412 


3.10 


12,720 


3,05 


68,074 


3.05 


10,564 


3.06 


2,699 


3.28 


2,266 


2.95 


10,806 


3.04 




1 10 










4 647 


3.00 


5,057 


191 


•M^s-'.-.'ASVls-.'.'.'.'.'.s 

1^ 


.1..?:??.. 


1,266 


^o^vi'-'. : iv.'i ••. ; 

2.94 

;;;■;■::!:::»::; 


6,155 


3.08 

••>i'i$x$S:«:' 
.•.v..y«yA".v.; 


1,764 


3.11 


587 


3.32 


335, 


2.80 


1422 


2.91 


226 


»?;V-;viv.y.v,',',>,v.'-.' 

150 


39 


2.41 


44 , 


2.89 


,244 , 


" 2.25 


43 


■;':;>fX;::;;:::<;:«;> :■; 


10 




iSiiSi 

11 


2.36 


iiiiiSS 

46 

iSifii 


2.78 


592 


•:•:■^>;■:•J■.•;^■•^;■■.•^:•;■.■^^ 

2.74 




''*'""2.78 


m 




5Tj 


2.69 


mm 

196 


2.89 


44 




37 


2.89 


■fiiiiiil:! 
^210 , 




6^ 


3.09|, 


1419 


3.34 


mm. 

1,467 


3.03 


6,864 


3.12 


1,451 


3.09 


406 


3.25 


244 


2.92 


1.347 


3.13 



1989 

Category 

National 

California 

Men 

lllllllllll^ 
Women 

Asian 

Black 

American Indian 

Hispanic/Latino 

..■•■■^^^^^^^^^^^^^^^^ 
Other 

NVhite 

No response 



American History 
Number Score 



Biology English Language English Literature 
Number Score Number Score Number Score 



87,971 
15,464 



2.80 
2.78 



7,753 2.91 

7,711 2.64 

3,925 2.80 

363 2.24 

119 2.56 

1,464 2.40 

417 2.75 

Jll 2.9' J' 

8,120 2.84 

1,056 2.96 



\685 
5.025 



3.02 
3.20 



2,637 3J0 



2,388 3.09 



1,774 3.23 

71 2.89 

24 2.17 
242 



134 

"■2.9 
2,412 

368 



2.70 
3.01 
3.24 
3.29 



23,171 
4,031 



3.02 
2.98 
2.96 



97,457 3.10 
15,475 3.09 
6,377 3.07 




Number 


Score 


Number 


Score 


•ic 70') 


? on 






4,705 


3.15 


2.613 


3.47 


2,907 


3,29 


1,051 


3.41 


■^19- 




.40.2 




l.i'.'^... 


2.94 


U62 


3.52 


1,349 


3.18 


195 


2.87 










62 


2J50 


47 


2.43 






01 

.,.....«?•»• . 




16, 


3.25 


7 


2.86 






. 0.3 \ 




252 


2.73 


761 


4.37 






.33.4 


103 


2.97 


50 


3J2 


2,356 


3.20 


1,217 


3.00 










567 


3.19 


336 


3.66 


Calculus 


Spanish 


Number 


Score 


Number 


Score 


59,611 


3.05 


18,602 


3.31 


9,081 


3.18 


6.439 


3.56 


5,314 


3.28 


2.497 


3.54 






38.8 




3,767 


3.04 


3.942 


3.56 


■ „., ,. 414 




61.2 




3,251 


3.19 


307 


2.92 


:.v."..?8.2 




13.3 




157 


2.38 


83 


2.65 






1.4 




29 


2.90 


22 


2.32 


0,3 




0.4 




741 


2.68 


3.007 


4.19 


8.7 




49.4 




212 


3.09 


101 


3.14 


24 




1.7 




4,115 


3.31 


2.064 


.1.96 


48.4 




■' 33.9 " 




576 


3.16 


355 


3.50 



Source: The College Board, 1985 Advanced Placement Program. National and California Summary Reports. 
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the tremendous growth in participation^ overall 
performance on test examinations has changed lit- 
tle over the last five yaars except for a noticeable de- 
cline in United States History scores in 1989. 

Overall, more examinations were taken by men 
than by women. Men completed more examinations 
than women in mathematics, science and social sci- 
ence areas, while more women than men completed 
examinations in English, foreign languages, and 
fine arts. However, the only subject areas in which 
mean scores of California women were greater than 
those of men were in English, French Literature, 
and German Language. 

Participation and performance on Advanced Place- 
ment examinations varied considerably among 
California test takers from different ethnic groups. 
While the numbers of tesi takers in all ethnic sub- 
groups in California increased substantially, the 
proportion of White test takers who completed the 
six examinations listed in Display 20 dropped from 
65 percent in 19CS to 56 percent in 1989, The pro- 
portion of test takers who were Asian increased by 
the largest margin - 4 percentage points. Hispanic 
proportional representation also increased by 3.7 
percentage points, primarily the result of a 10 per- 
centage point increase in their participation in the 
Spanish exam. The increase in the proportion of 
Black test takers was very slight - only .1 of a per- 
centage point. Despite these gains, participation of 
Black and Hispanic high school students in Ad- 
vanced Placement examinations is far below their 
representation in the State's high school student 
population. 

For the six examinations in Display 20, mean scores 
for Black test takers were below the qualifying 
score of 3. Among Hispanic test takers, their mean 
score of 4.19 on the Spanish exam was the only one 
in which a qualifying average was attained. For 
Asian test takers, mean scores below the qualifying 
<S occurred in American History, English Language 
and Spanish while White test takers failed to 
achieve a mean score at or above the qualifying 
score of 3 in American History and Spanish. 

Information on the standard errors of measurement 
and predictive validity of Advanced Placement ex- 
aminations is not currently available. 



Test of English as a Foreign Language 

The Test of English as a Foreign Language (TOEFL) 
evaluates the English proficiency of test takers 
whose native language is not English. The test con- 
sists of three sections: Listening Comprehension 
that measures the ability to understand English as 
spoken in North America; Structure and Written 
English that measures the ability to recognize lan- 
guage that is appropriate for standard written Eng- 
lish; and Vocabulary and Reading Comprehension, 
that measures the ability to understand nontechni- 
cal reading materials. The two-hour test contains 
150 items and generates scores that range from 200 
to 677. The Educational Testing Service adminis- 
ters the test, in cooperation with the College Board 
and the Graduate Record Examination Board. 

More than 2,500 colleges and universities in the 
United States and Canada, as well as in other coun- 
tries where English is the language of instruction, 
require TOEFL test results of both graduate and un- 
dergraduate applicants for whom English is not 
their native language and whose last three years of 
instruction were not in English. California's public 
universities are among those colleges who require 
these test results to accompany applications for ad- 
mission. No specified passing score exists for the 
TOEFL. Each institution requiring these scores de- 
termines its own levels of acceptable performance 
and these often vary depending on such factors as 
field of study, level of study (graduate or undergrad- 
uate), teaching assistantships or fellowships, and 
whether the institution provides ESL or EFL courses. 
In general, a total TOEFL score of 600 or above is 
considered excellent and a score below 400 is re- 
garded as weak. 

Participation and performance 

The Test of English as a Foreign Language was tak- 
en 578,722 times in 1988-89. National and Califor- 
nia average scores are not available for TOEFL, nor 
are other data available about either the number of 
tests administered in California or the number of 
test takers requesting that their scores be sent to 
California institutions. 

According to the TOEFL Test and Score Manual 
analysis of twelve forms of the TOEFL administered 
between December 1984 and February 1986 gener- 
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ated a mean standard error of measurement of 14.1 
points for the total score. If an individual repeated- 
ly took various foitns of the TOEFL^ nine times out of 
ten his/her score could be expected to vary by as 
much as ± 28.2 pointo. Thus» scores of two individu- 
als would need to differ by more than Ihis amoimt 
before one could conclude any real difference exist- 
ed in their English proficiency as measured by this 
test. 

Predictive validity 

For the TOEFL, che issue of validity relates to how 
well the test measures a person's proficiency or abil- 
ity to function or perform using English. The Man- 
ual summarizes a number of predictive validity 
studies of TOEFL using a wide range of criterion or 
outcome variables. One series of studies examined 
the correlations between TOEFL scores and scores on 
other English proficiency tests; the correlations 



ranged from .79 lo .89. Another set of studies corre- 
lated faculty ratings of students' English proficien- 
cy with TOEFL scores and yielded correlations with a 
range of .76 to .87. In another study which com- 
pared TOEFL performance with ratings of actual 
writings a correlation of .78 was found between 
TOEFL scores and average ratings of writing quality 
on four essays. Other studies have been conducted 
that examine the relationship between TOEFL and 
some widely used aptitude tests. For nonnative 
speakers of Englisht the correlation between TOEFL 
scores and SAT Verbal scores was .77, between 
TOEFL and GRE Verbal was .78 and between TOEFL 
and GMAT Verbal was .71. The TOEFL test does sys- 
tematically measure some of the skills in English 
that are considered important for success in colle- 
giate institutions in this country but, as is the case 
with most standardi'/ed examinations, its scope is 
limited and its ability to predict subsequent perfor- 
mance is imperfect. 
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Tests Used by Graduate Programs 
and Professional Schools 



PART TWO of this report reviews major standard- 
ized tests used for admission or placement in gradv 
ate programs or profeissional schools. The organiza- 
tion of information about each test parallels that 
used for the undergraduate tests. For each test, the 
report describes the nature and purpose of the test, 
presents data on participation and performance by 
sex and ethnic group over the last five yean; to the 
extent that data are provided by the test's sponsor, 
and presents available data on the test's standard 
error of measurement and i>redictive validity. 

A cautionary note regarding predictive validity is 
in order. Because of the selective nature of most 
graduate programs and professional schools, very 
little variation exists among graduate students' un- 
dergraduate grades and test scores and even less ex- 
ists among their graduate level grade-point aver- 
ages. This limitation of the range of variability 
among test takers in their background characteris- 
tics is technically known as ^restriction of range." 
When restriction of range exists, the ability of a pre- 
dictor variable to explain variation in outcome mea- 
sures is quite limited. In rep.l terms, when all of the 
entering students have high test scores and grade- 
point averages, the characteristics that differenti- 
ate an outstanding graduate student from a medio- 
cre one probably lie in an entirely different realm. 



Graduate Record Examinations 

The Graduate Record Examinations (GRE) consist of 
a General Test and 16 Subject Tests. The GRE Gen- 
eral Test is an aptitude test designed to measure 
certain developed verbal, quantitative, and analyt- 
ical abilities through seven 30-minute tests. Ver- 
bal, Quantitative, and Analytic scores are reported 
that have ranges from 200 to 800. The Subject Tests 
are achievement tests designed to measure subject 
matter knowledge and understanding acquired in 
an undergraduate program as preparation for 
graduate study. Each Subject Test takes two hours 
and 50 minutes. The ranges of scores on the Subji^ct 



Tests varies from test to test but 200 is the mini- 
mum and 990 is the maximum jiossible score. 

These tesits are used by graduate schools and de- 
partments for admission, placement, and fellow- 
ships, and by fellow.ship donors for appraisal of pro 
spective recipients of their awards. The use of the 
scores varies from campus to campus, from depart- 
ment to department. Within the University of Cali- 
fornia, no campus or department has published cut- 
off scores. At the departmental lev.^1, some pay lit- 
tle attention to GRE scores, while others emphasize 
different portions of the test in admission decisions. 

Participation and performance 

In 1988-89, 366,077 individuals took GRE tests na- 
tionwide, an increase of 15 percent over the pre- 
vious year. In California, 29,865 individuals took 
the GRE tests, an increase of 2 percent over 1987-88. 
While more detailed information about differential 
participation and performance on the GRE among 
California test takers is not available, a soon to be 
published report by the Educational Testing Service 
does provide considerable information about these 
test takers nationwide. Of those Individuals who 
took GRE tests nationwide in 1987-88, 221,638 were 
United States citizens for whom general test score 
information and demographic information were 
available. 

As shown in Display 21 on page 20, overall, a larger 
proportion of women than men take the GRE Gener- 
al Test and this proportion has increased over the 
last ten years. While participation in the GRE has 
increased among members of all ethnic subgroups, 
the largest rates of increase have occurred among 
Asian and Hispanic test takers. The small increase 
for Black test takers is solely the result of more 
I^lack women taking the GRE; their increase masks 
^n actual decline in GRE participation by Black 
males. Despite these gains by ethnic groups under- 
n presented in graduate education, 86 percent of ail 
GdE participants continue to be White test takers. 
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DISPLAY 21 Participation of United States Citizens in Graduate Record Examinations, 1977-78 
and 1987^88 



Category 



1977-78 



1987-88 



Percent i 



Scores in 1987-8 





11 Number 


Pcrccnl 


Number 


Percent 


Change ij 


i Verbal 


Quantitative 


Analytic 


Total 


1 188309 




197,686 






I 508 


537 


542 


Men 


i 87^309 


46.3 


95,142 


42.9 


9.oi 


:i 519 


583 


557 


Women 


% 10U19 


53.7 


126,496 


57.1 


25.0|| 


: 499 


502 


531 


Asian 


1 2.686 


14 


6,133 


3.0 


128.3| 


\ 480 


612 


539. 


Black 


1 12451 


6.9 


12492 


6.2 


0.3 11 


: 391 


394 


406 


American Indian \ 


if 917 


04 


1,000 


04 


9.ii 


\ 464 


470 


485 


Hispanic/Latino ; 


4,806 


2.7 


7,158 


34 


48.9ii 


\ 440 


470 


461 


Other 


ii 4483 


24 


2427 


1.2 


-44.9|i 


\ 528 


549 


542' 


White i 

• • 


1 155,793 


85.9 


173,674 


854 


11411 


; 520 


546 


557 



Source: California Postaecondary Education Commiaaion. 



Just as was the case for undergraduate standard- 
ized tests, mean performance varied considerably 
among ethnic groups. The difference between the 
mean scores of the group with the highest scores 
and those with the lowest scores exceeded the stan- 
dard deviation of the overall mean. The lack of his- 
torical data on GRE scores disallowed determination 
of whether any changes in relative performance lev- 
el have occurred over time. 

The 1988*-89 GRE Guide presented estimates of the 
standard .error of measurement on the Verbal mea- 
sure as 34, on the Quantitative measure as 37, and 
on the Analytic measure as 45. About 96 percent of 
the time, individuals will have scores within two 
standard errors of their true score. Thus, exami* 
nees can be expected to obtain scores ou the Verbal 
measure within 68 points of their true score, within 
74 points of their true score on the Quantitative 
measure, and within 90 points of their true score on 
the Analytical measure. When comparing scores of 
two individuals, the size of the difference in their 
score must be even greater than these differences 
before one could conclude any real difference exists 
between the two test takers as measured by the 
GRE. 

Predictive validity 

The GRE General Test and/or Subject Area Test 



scores are useful for admission decision making if 
they are meaningful indicators of students' likeli- 
hood of success in graduate programs. The Validity 
of the GRE: 1988-89 Summary Report (in press) pre- 
sented predictive validity correlations of first year 
grade-point averages in graduate programs with 
GRE General Test scores and undergraduate grade- 
point averages. The predictive validity correlation 
of undergraduat grades with first-year graduate 
program grades > .34 while the GRE composite 
scores had a correlation of .33 with first-year 
grades. When undergraduate grades and GRE com- 
posite scores are used together, the predictive valid- 
ity correlation increases to .43. While either under- 
graduate grades or the GRE composite score explains 
about 11 percent of the variation in first-year 
graduate programs grades, they explain about 18 
percent of variance when used together. 

Another analysis examined the predictive validity 
of eight Subject Area tests. In all cases except Geol- 
ogy, the predictive validity correlations of subject 
area scores and undergraduate grades with first- 
year graduate grades were greater than or equal to 
the correlations when the GRE composite score was 
substituted for the Subject Area score. While the 
predictive validity corr iiations are the largest when 
all three indicators are used, only in the case of Ge- 
ology does the addition of the GRE composite scores 
to ur.dsrgraduate grades and Subject Area test 
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scores increase the proportion of the variance ex- 
plained by as much as 1 percentage point. 



ferences in performance (GMAT 1988-89 Bulletin of 
Information^ p.33). 



^'Participation and performance 



Graduate Maimgement Admission Test 

The Graduate Management Admission Test is an 
aptitude test that measures general verbal and 
mathematical skills that are associated with suc- 
cess in the first year of study at graduate schools of 
management. The test does not examine knowledge 
obtained in college course work or any particular 
subject area. It consists of seven separately timed 
sections of multiple choice questions. Test takers 
receive separate verbal and quantitative scores that 
have ranges from 0 to 60 and a total mean score that 
has a range from 200 to 800. 

The GMAT scores are used by many graduate schools 
of management in California as one component in 
their admission procedures. The GMAT General 
Bulletin reiterates that use of the test results as a 
sole or pivotal basis for admission is inappropriate 
because of its known limitations: (1) it cannot and 
does not measure all the qualities important for 
graduate study in management and other pursuits, 
whether in education, career, or other areas of ex- 
perience; (2) there are psychometric limitations to 
the test - for example, only score differences of cer- 
tain magnitudes are reliable indicators of real dif- 



Nationally, 221,455 GMAT tests were taken in 1988- 
89, a 4 percent increase over the previous year. In 
California, GMAT test taking increased by 3 percent 
to 17,388 in 1988-89. Display 22 below presents 
participation and performance data for the GMAT 
nationally and in California for the three years 
these data were available. 

Display 23 on page 22 shows that total mean GMAT 
scores increased over the last three years. Califor- 
nia test takers have consistently earned higher 
scores than GMAT test takers nationally. All of the 
improvement in the mean scores is the result of 
higher scores earned by men. Scores for women ac- 
tually declined slightly over this period as Display 
24 indicates. While both men and women in Cali- 
fornia score above the national average, California 
men actually increased their relative advantage 
over the last three years while California women's 
advantage decreased slightly. While women's rep- 
resentation among undergraduate admission ex- 
amination takers is nearly equivalent to their rep- 
resentation in their high school class - 51 to 52 per- 
cent *- women comprise only 37 percent of the GMAT 
test takers both nationally and in California. 



DISPLAY 22 Participation and Total Scores of Test Takers on the GMAT Nationally and in 
California by Sex and Ethnicity, 1986-87 Through 1988-89 



P«rtidp>tion 



Composite Score 







Natioaal 




CftUfomia 






! Natioaal 






California 




Catcgoty 


1986^7 


1987-88 


1988^ 


1986-S7 


1987-«8 


1988^9 ; 


1986-87 


1987-88 


1988-89 


1986^7 


1987^8 


1988-89 


Total • 


197,793 


212^380 


221,455 


16,049 


16,916 


17,388;.;. 


x 485 


491 


492 


497 


503 


504 


Men 


125,182 


134^95 


140,334 


9,919 


10,549 


10,776:*; 


: 489 


498 


502 


502 


512 


516 


Women 


72,419 


77,624 


80,773 


6,114 


6,352 


6,602 


477 


477 


475 


488 


4H8 


484 


Asian 


3,860 


5,143 


5,809 


1,253 


1,643 


1,751 


4£S 


493 


493 


489 


501 


498 


Black 


7,926 


9,642 


9,969 


518 


667 


657 . 


■ 383 


389 


391 


408 


417 


423 


American Indian 


430 


2,654 


3,838 


55 


158 


224: 


: 463 


458 


464 


483 


476 


490 


Hij»panic/Latino 


2,164 


2,714 


2.764 


407 


492 


512 


429 


437 


439 


461 


467 


470 


White 


115,753 


120,775 


120,143 


9,013 


9,168 


8,954^ 


503 


508 


511 


515 


531 


534 



* Subgroups do not add to total because of nonresponse, non-citizenship, or missing data. 
Source: Graduate Management Admission Council, Statistical Print-outs, 1987, 1988, and 1989. 
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DISPLAY 23 Total GMAT Scores Nationally 
and in California, 1986-87 Through 1988-89 




0 \ , , 

1986^ 1987^ 1988*89 

Source: California Poatsecondary Education Commiaaion. 



Mean GMAT scores differ across ethnic groups in 
California by more than 100 points, as Display 25 
indicates. However, the gap narrowed somewhat 
(by six points) over the three years reported even as 
participation of students from ethnic minority popu- 
lations was increasing. Nevertheless, White test 
takers still comprised 74 percent of the GMAT test 
takers in California in 1988-89. 

The Technical Report on Test Development and 
Score Interpretation for GMAT Users (1986) summa- 
rizes data on the standard error of measurement for 
this test. The mean, standard error for the total 
GMAT score is 26.5 points while for the verbal and 
quantitative scores, the standard errors are 3 points 
on each. 



DISPLAY 24 Total Mean Scores on GMAT 
Nationally and in California for Men and 
Women, 1986-87 Through 1988-89 
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Source: California Postsecondary Education CommiBsion. 



DISPLAY 25 Total Mean Scores on GMAT 
in California by Ethnicity, 1986-87 Through 
1988 39 
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Source: California Postaecondary Education Commission. 
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Predictive validity 

Examinations of predictive validity of the GMAT 
have focused on the correlation of first-year gradu- 
ate program grade-point average with GMAT verbal 
and quantitative scores and undergraduate grade- 
point average. The 123 studies of GMAT predictive 
validity conducted between 1981 and 1984 yield a 
mean predictive validity correlation of .25 between 
first-yearprogram grades and undergraduate grade- 
point averag'^s and a multiple correlation of .41 be- 
tween first-yt:;:r grades and the combination of un- 
dergraduate grades and GMAT verbal and quantita- 
tive scores. Thus, the proportion of variation in 
first-year grades that can be explained increases 
from 7 percent using undergrf^duate graded alon^ to 
17 percent when GMAT results are added. 



Law School Admission Test 

The Law School Admission Test (LSAT) is an apti- 
tude test designed to measure the general aptitude 
or ability to read, understand, and reason. The test 
covers a range of academic disciplines and is de- 
signed to ^ve no advantage to test takers who have 
studied a specific discipline. The LSAT is intended 
as a supplement to the undergraduate record and 
other information for use by law schools when as- 
sessing the academic potential of applicants for law 
school work. 

The half-day test consists of five 35-mitiUte sections. 
Four sections have a multiple choice question for- 



mat and include a pre-test section, and sections on 
analytic reasoning, logical reasoning, and reading 
comprehension. An unscored thirty-minute writing 
sample is also a required part of tha test. The scaled 
scores range from 10 to 48. 

Participation and performance 

Nationally, 121,978 people took the lsat in 1988- 
89, a 27 percent increase over 1987-88. While a sub- 
stantial increase has occurred in LSAT participation 
over the past five years, year-to-year levels of par- 
ticipation fluctuate considerably as illustrated in 
Display 26 below. California participation data 
have been reported for the last four years. Partici* 
patios \n the LSAT included a dramatic 57 percent 
increude over last year, for a total of 13,394 test tak* 
ers in 1988-1 9. However, fluctuations in participa- 
tion in California parallel the national pattern and 
show a 42 percent increase over the last four years. 

In 1988-89, approximately 44 percent of the LS.\T 
test takers nationwide were woinen, representing a 
2 percent increase in female participation over the 



past five years. In California, women comprised 46 
percent of the test-taking pool, and they have in- 
creased their representation by nearly 3 percentage 
points since 1985-86. 

In 1988-89, 83 percent of all LSAT test takers nation- 
all*' were White candidates - about a 1 percentage 
point decrease over five years ago. Asian represen- 
tation had increased by 2 percentage points to 4.2 
percent. While 1988-89 Black representation of 7.5 
percent was about average for the period, Hispanic 
representation was fairly stable at about 5 percent. 

Over the last four years, the representation of 
White test takers had decreased 1.5 percentage 
points to 73.4 percent of all LSAT takers in Califor- 
nia. Asian representation increased 3 percentage 
points to 9.4 percent and Hispanic r ^t: resentation 
increased by 1.1 perceiHage pn'ntb tu "A percent 
while Black representation was quite stable at 
about 7 percent. 

DiiTerential performance data, included in Display 
26, was provided for the first time in 1988-89. The 
mean national score on the LSAT was 30.0 while the 



DISPLAY 26 Participation in Law School Admissions Tests Nationally and in California by Sex 
and Ethnicity, 1984^85 Through 1988-89 



Category 






Nunber 






National 


19S4-aS 


1985^ 


198M7 


1987-88 


1988-89 


Total' 


99,173 


81,810 


101,244 


96,203 


121,97B 


Men 


57,739 


49,086 


57,297 


53,776 


68358 


Women 


41,434 


32,724 


43,947 


42,427 


53.470 


Asian 


2,207 


2,165 


2,978 


3.015 


4.839 


Black 


6,905 


6,791 


7^73 


6,736 


8,599 


Amerirun Indian 


564 


518 


543 


468 


602 


Hispanic/Latino 


4,529 


4,572 


4.977 


4.248 


5.668 


Other 


1.787 


435 


1.831 


1.042 


108 


White 


82,662 


73.441 


82373 


76.300 


94.470 


California 












Total^ 


N.R, 


9,413 


10.090 


84128 


13,394 


Men 


N.R. 


4,591 


5^28 


4,641 


7,220 


Women 


NR. 


3,496 


4.562 


3.887 


6,159 


Asian 


N.R. 


521 


771 


680 


1.156 


Black 


N.R- 


542 


733 


580 


881 


American Indian 


NR. 


70 


86 


71 


110 


Hispanic/Latino 


NR. 


647 


860 


658 


1.117 


Other 


NR. 


247 


308 


89 


15 


White 


NR. 


6,060 


7.235 


5.990 


9,027 













Mcun 






Percent 






Score 


1984-85 


1985-86 


1986-87 


1987-88 


1988-89 


1988-89 












30.0 


58.2 


60.0 


56.6 


55.9 


56.1 


NR. 


41.8 


40.0 


43.4 


44.1 


43.9 


N.R 


2.2 


25 


3.0 


3.3 


4.2 


NR. 


7.0 


7.7 


7.6 


7.3 


7.5 


NR. 


0.6 


0.6 


05 


05 


0.5 


N.R. 


4.6 


5.2 


5.0 


4.6 


5.0 


N.R. 


1.8 


05 


1.8 


1.1 


n t 


.V.R. 


83.8 


83J 


82.1 


33.1 


82.7 


\,R. 












30.3 




56.8 


54.8 


54,4 


54.0 


30.5 




43.2 


45.2 


45.6 


46.0 


30.0 




6.4 


7.7 


8.4 


9.4 


29.7 




6.7 


13 


7.2 


7.2 


22.4 




0.9 


0.9 


0.9 


0}) 


27.8 




8.0 


8.6 


8.2 




26.3 




3.1 


3.1 


1.1 


0.1 


25.9 




74.9 


72.4 


74.2 


73.4 


12.0 



* Subgroups do not add to total because uf nonresponse, noncitizenship, or missing data. 
N.R. « Not Reported. 

Source: California Postaecondary Education Commission. 
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m^an score for California test takers was 30.2. Dif- 
ferential scores for men and women and for major 
ethnic groups were available for California test tak* 
ers only. The mean LSAT score for men of 30.5 was 
slightly greater than the women's mean score of 
30.0. As has been the case for all of the standard- 
ized tests included in this report, substantial differ- 
ences in mean scores occurred for test takers from 
the major ethnic groups. The range of these scores 
in 1988-89 was 32.0 for White test takers to 22.4 for 
Black test takers. Because no recent historical data 
on mean performance levels of test takers in Cali- 
fornia or nationally has been provided, it is not pos- 
sible to determine if any changes have occurred in 
the relative performance of candidates from the var- 
ious ethnic groups. 

The 1988-89 LSAC/LSAS Desk Book estimates that 
the standard error of measurement for a LSAT score 
is 2 points on the 10 to 48 scale. Thus, nine times 
out often, a test taker's score could vary by 4 points 
without indicating any change in the test taker's 
abilities as measured by the LSAT. When comparing 
the scores of two candidates, the difference between 
their scores should exceed five before it could be 
concluded any real difference existed between their 
abilities as measured by the LSAT. 

Predictive validity 

The relationship between performance on the LSAT 
and performance in law school varies from law 
school to law school The Law School Admission 
Services' most recent report to the Commission pro- 
vided summary information on recent studies of the 
predictive validity of the LSAT results conducted at 
156 of its member law schools. The range of correla- 
tions between LSAT scores and first-year law school 
grades was .19 to .64. When undergraduate grades 
were added to the LSAT scores, the range of the cor- 
relations increased to .28 to .69. 

Information on the predictive validity of the LSAT 
for different subgroups of test takers in this report 
is based on a 1976 research study. Subgroup Valid- 
ity Study, LSAC-76-6. The most striking fact from 
this research is that undergraduate grades have a 
very low correlation with first-year law school per- 
formance for Black and Hispanic candidates. While 
LSAT results for these test takers have higher corre- 
lations with Hrst-year law school grades than do 
their undergraduate grades, the degree of correla- 

O 
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tion between first-year law school grades and LSAT 
results either alone or in concert with grades is low- 
er for these students than for White and Asian stu- 
dents. However, predictive validity findings in a 
1977 LSAC research report 77-3 found correlations 
between first-year law school grades and LSAT 
scores alone or in concert with undergraduate 
grades are higher for Blacks and Hispanics than for 
Whites or Asians. Differential predictive validity of 
the LSAT is the focus of research currently underway 
and that data will be included in the Commission's 
1992 report. 



Medical College Admission Test 

The Medical College Admission Test (MCAT) is a 
standardized multiple-choice test designed to evalu- 
ate understanding of concepts and principles in biol- 
ogy, chemistry, and physics identified by the Associ- 
ation of American Medical Colleges as prerequisite 
to the study of medicine. It is difficult to classify the 
MCAT because i^. assesses knowledge of concepts and 
principles covered in first^year introductory science 
courses and as such is an achievement test. It is 
also an aptitude test because it attempts to assess 
basic analytic abilities in the context of medically 
relevant problems and data. The MCAT provides six 
scores - one each in Biology, Chemistry, Physics, 
Science Problems, Skills Analysis: Reading, and 
Skills Analysis: Quantitative. Scores range from 1 
to 15. 

The MCAT was designed to assist medical college ad- 
mission committees in identifying applicants who 
will perform adequately in the medical school cur- 
riculum. The scores are intended for use in combi- 
nation with a wide variety of preadmission data for 
applicants. While the extent and nature of the use 
of MCAT results varies from one California medical 
school to another, they are considered in conjunc- 
tion with undergraduate grades and course work, 
undergraduate institution, recommendations of ap- 
plicants' health profession advisors, and personal 
interviews. 

Participation and performance 

In 1988, 34,167 MCAT tests were taken nationally - 
a 3 percent decrease from the previous year, as Dis- 
play 27 below shows. In California, 3,500 test tak- 



ers completed the MCAT- a 2 percent increase in 
participation. Since 1985, California has increased 
its representation among national test takers by 1 
percentage point to 10.2 percent. 

No breakdown of California test takers by sex or ra- 
cial/ethnic group is available. Nationally, however, 
women comprised 41.7 percent of the MCAT test tak- 
ers in 1988 having increased their representation 
by more than 10 percentage points over the last four 
years. Over this same period, the representation of 
White test takers declined from 74.5 percent to 69.7 
percent. The greatest increase in representation oc* 
curred for Asian/Pacific Islander test takers, who 
expanded their proportion to 14.7 percent - a 
growth of 4.3 percentage points. Black representa- 
tion increased from 7.9 percent to 8.2 percent while 
the representation of Mexican American/Chicano 
test takers changed from 1.7 percent to 1.9 percent. 

As illustrated by Display 28 on page 26, California 
test takers have consistently earned higher MCAT 
scores than the national average. However, since 
1985, mean test scores have declined, and the rate 
of decline has been greater for California scores 
than for the national scores. 

Although separate mean test scores for men and 
women and for racial/ethnic subgroups are not 
available for California, nationally women tend to 
earn slightly lower scores than men, and mean 
scores in each test area for Black test takers are 



more than two full points below those for White and 
Asian/Pacific Islander test takers. 

The standard errors for measurement for the MCAT 
tests range from .87 in Chemistry to 1.0 in Reading 
Skills on the scale of 1 to 15. Thus, if an individual 
repeatedly took the MCAT, 95 percent of the times 
the test taker's scores could fluctuate as much as 2 
points without indicating any real change in abili- 
ties as measured by this test. 

Predictive validity 

The correlations between first-year medical school 
grades and MCAT test scores range from .26 for 
Reading Skills to .42 for Chemistry. The combined 
correlation of all area tests wilh first-year medical 
college grades is .41, while their correlation with 
second-year medical college grades is .37. Vari- 
ations in MCAT scores explain about 18 percent of 
the variation in first-year medical college grades 
and about 10 percent of the variation in second-year 
medical college grades. 



California Basic Educational Skills Test 

This report contains the first presentation of infor- 
mation about the California Basic Educational Skills 
Test (CBEST) to appear in this series. When the test- 



DISPLAY 27 Medical College Admission Test Participation Nationally by Sex and Ethnic Group, 
and Overall in California, 1985, 1987, and 1988 



Category 




Putidpatioii 




Participation Rate 




i9as 


1987 


1988 


1985 


1987 


vm 


Natioflal 


42,432 


35,204 


34,167 








Men 


25,866 


20,829 


19,930 


69.0 


59.2 


58.3 


Women 


16^66 


14.375 


14,237 


31.0 


40.8 


41.7 


Asian 


4,412 


4,753 


5,012 


10.4 


13.5 


14.7 


Black 


3,315 


2,966 


2,818 


7.9 


8.4 


8.2 


Hispanic/Mexican American 


719 


599 


660 


IJ 


1.7 


1.9 


Hispanic, Other 


2,165 


1,844 


1,681 


5.1 


5.3 


5.0 


American Indian 


176 


176 


177 


0.4 


05 


0.5 


White 


31,625 


24,866 


23,819 


74.5 


70.6 


(,9.7 


California 


3,885 


3.420 


3^00 


9.2 


9,7 


10.2 



Source: Medical College Admission Test, Summary of Score Diatributions, 1985, 1987, 1988. 
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DISPLAY 28 Medical College Admission Test Performance by Test Area, Nationally by Sex and 
Ethnic Group, and Overall in California, 1985, 1987, and 1988 





III 




Biology 






Chemistry 






Physics 






mm 




1987 


1^^ 




1^) 


1988 


1985 


1987 


1988 


National 


ipir 

m 


8.16 


8.08 


8.09 


8.02 


7.82 


7.75 


8.04 


7.84 


7.82 


Men 


m 


838 


8.31 


835 IHi 


8J3 


8.12 


8.06 


8.52 


T20 


8.27 


Women 




7,82 


7.75 




7i4 


7.40 


7.32 


7.30 


8.28 


7.18 


Asian 


m 


8.48 


8J2 


8i5 


8.85 


8.74 


8J7 


8.92 


8.75 


8.69 


BUck 


1 


5.92 


6.06 


6.11 iiil 


5.92 


5.88 


5.82 


5.68 


5.74 


5.65 


Hispanic, Mcx. Amer. 




7.45 


7J2 


7i9 s^jiri 


6.98 


6.81 


6.82 


6.90 


6.76 


6.79 


Hispanic, Other 




A Al 
0.4 / 


6J4 


6.70 


0.*rt 


O.JO 


0.*tl 


6.24 


6.17 


O.ji 






6.93 


7.05 


7.25 iJP 


6.68 


6.61 


6.77 


6.71 


6.66 


6.97 


White 

TT III W 


iii 


8.49 


8JJ7 


835 III! 


8*27 


8.02 


7.94 


8.32 


8.07 


8.03 


C^iifomia 






9.07 


9.15 

MM 


9.19 


8.86 


8.87 


9.15 


8.84 


8.84 








:\<c■^:'<^•■:':^v;%■:^^^■'.V^^v:•:•:v:^^^ 

Science Problems 




■:v;■V;V:^■^■:■;■ ;-;^:vL- :■:-:-:■:■ 

Reading Skill 




Quanliiaiive Skill 












1988 




170 / 




1985 


1987 


lOftft 
1 /oo 


Nattooal 




7.93 


7,15 




7.75 


7J2 


7.55 


7i5 


7.51 


T34 


Men 




8.29 


8.07 


8.10 i'ii?? 


7.73 


7^ 


755 


7.87 


7.80 


7.68 


Women 


i?» 


7.38 


7.27 


7.30 


7.78 


7.48 


7i5 


7 05 


7.08 


6.87 


Asian 


*•'•'.•:•>:•:■:• 


8.61 


8.49 


li 


7.35 


7.14 


7.08 


7.74 


7.72 


7.45 


Black 


Mm 


5.63 


5.69 


5.69 


5.20 


5.09 


5.25 


4.82 


5.08 


4.85 


Hispanic, Mex. Amer 




6.93 


6.78 


6.87 


6.78 


634 


6.70 


6.35 


6.28 


6.19 


Hispanic, Other 




6.18 


6.08 


6.30 


5.08 


5.04 


5.S2 


5.20 


535 


5.27 


American Indian 




6.63 


6.68 


6.93 


6.94 


6.86 


7.28 


6.57 


6,67 


6.70 


White 




8.23 


8.00 


7.99 


8.29 


8.09 


8.10 


800 


7.)5 


7.80 


California 




9.08 


8.74 


8.86 


8.11 


7.62 


7.62 


8,15 


7.93 


7.75 



Source: Medical College AdmlBsion Test^ Summary of Score Distributions, 1986, 1987, and 1988. 



ing legislation was passed in 1985, CBEST was a 
very new test, and its use, according to its enabling 
legislation, was as a requirement for issuance of a 
first teaching or service credential. Thus, staff of 
the ComiHission on Teacher Credentialing and the 
Postsecondary Education Commission agreed that 
its use did not tit the description in the testing legis- 
lation as an instrument used for admission or place* 
ment in postsecondary education in California. Now, 
however. Education Code Section 44252 requires 
that the applicants to approved teacher preparation 
programs in California must take the CBEST for di- 
agnostic purposes prior to application for admission. 
Thirty-nine percent of those taking CBEST in 1988- 
89 indicated that their reason for taking the test 
was for admission to a professional preparation pro- 
gram. For these reasons, CBEST should be included 
in this report and the sponsors of the test should be 
requested to comply with the Education Code Sec* 
tions 99152 to 99155. The information on CBEST in 



this report is drawn from the October 1989-August 
1990 California Basic Educational Skills Test Infor- 
mation Bulletin and The California Basic Educa- 
tional Skills Test: Annual Report of Examination 
Results, prepared by the Commission on Teacher 
Credentialing in September 1989. 

The purpose of the CBEST is to provide a general 
measure of basic proficiency in reading, writing, 
and mathematics. The test consists of a reading sec- 
tion (65 minutes) which includes the skill areas of 
literal, inferential, and critical comprehension; a 
mathematics section (70 minutes) which covers the 
process used in problem solving, solutions of applied 
problem'^, and mathematical concepts and relation- 
ships, and a writing section (60 minutes) in which 
test takers m ;st complete short essays on two top- 
ics. 

In order to pass the CBEST, a test taker must earn at 
least a minimum scaled score '^f 41 on each section. 
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Test takers may retake any section of the test that 
they fail for as many times as they need to pass. 
The summary of statistical information presented 
in Display 29 below focuses on passing rates 

Participation and performance 

In 1988-89, 40,627 individuals took CBEST for the 
first time. While this was a 2.6 percent increase 
over 1987-88, it was 5 percent lower than the num- 
ber who took the test in 1985-86 In fact, participa- 
tion in the last two years is 11 percent lower than 
the two-year period, 1986-87. Approximately 70 
percent of the test takers are women and 30 percent 
are men. While Hispanic participation increased by 
1.6 percentage points and White participation and 
other unidentified ethnic group participation de- 
clined somewhat, Asian and Black participation 
was quite stable over the four-year period. Howev- 
er, White test takers continue to comprise approxi- 
mately 80 percent of the CBEST test population and 
the participation of test takeis from other ethnic 



subgroups is far below their representation in the 
population. 

Passing rates for men and women are quite compa- 
rable, 74 percent and 73 percent, respectively. 
Variations in passing rates among test takers of dif- 
ferent ethnic groups is substantial While passing 
rates for Black and Hispanic test takers increased 
between 1985-86 and 1987-88, passing rates for 
these two groups dropped back to near their 1985-86 
levels in the current year. Thirty-five percent of the 
Black first- time test takers and 51 percent of the 
Hispanic test takers passed the CBEST in 1988-89. 
The passing rate for Asian test takers has been 
quite stable at 62 percent while the passing rate for 
White test takers has declined from 82 to 80 percent 
over the four-year period. Because of the nature of 
the CTC report, information about average scores, 
standard deviations, standard errors of measure- 
ment, and predictive validity of the CBEST are not 
available at this time. Through the cooperation of 
the test administrators, the Educational Testing 
Service, this information may be available for fu- 
ture reports 



DISPLAY 29 CBEST Participation and Passing Rates for First-Time Examinees by Ethnicity, 
1985-86 Through 1988-89 



Category 


19SS-86 




1986^7 


1987-88 




1988^9 






Number 9! 


»Pass 


Number 


%Pass 


Number 9^ 


> Pass 


Number 95 


7 Pass 


Total 


42,774 


75 


47,114 


75 


39,586 


75 


40,627 


74 


Asian 


1,125 


62 


1,257 


61 


1,012 


62 


1,133 


62 




2.8 




2.8 




2.8 




3.0 




Black 


1,997 


36 


2,111 


34 


1,532 


41 


1,764 


35 




4.9 




4.7 




4.2 




4.7 




Mexican American 


1,759 


50 


1,961 


59 


2,293 


56 


2,036 


51 




43 




43 




63 




5,4 




Other Hispanic/Latino 


754 


48 


833 


51 


1,482 


62 


954 


50 




1.9 




1.8 




4.1 




2^ 




Other 


1,421 


49 


2,076 


54 


1,908 


76 


994 


61 




3-5 




4.6 




5.2 




2.6 




White 


33463 


82 


37,088 


81 


28,124 


80 


30.801 


80 




82.6 




81.8 




77.4 




81.7 





Source: California Commiaaiort on Teacher Credentialing, The California Basic Education Skills Annual Report of Examination 
Results, September 1989. 
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Review of Selected Issues Related 
to Standardized Admissions Tests 



TFIE 1989 amendments to the statutes on reporting 
on standardized tests expanded the Commission's 
reporting responsibilities to include: specific recom- 
mendations on (1) methods to remove the inappro- 
priate obstacles that standardized college admis- 
sions tests may provide in precluding some students 
from obtaining regular admission to public colleges 
and universities and (2) strategies to involve the 
testing companies in cooperative actions with 
schools, colleges, and universities to expand access 
to college for Hispanic, Blacky and American Indian 
students. 

Even these rather narrow issues are quite complex 
and are interrelated with the entire array of issues 
and concerns the Commission has identified in its 
educational equity work. The first two parts of this 
report sought to present the role of testing as de- 
signed by test sponsors and the impact of such test- 
ing in a normative sense only. This part of the re^ 
port seeks to clarify the meaning of this language so 
that existing pertinent information can be re- 
viewed^ the need for additional information can be 
identified, and alternative methods and strategies 
discussed. 



Standardized testa and regular admission 

In its report on the eligibility of California's 1986 
high school graduates, the Commission examined 
the nature of graduates' pre-coUegiate preparation 
and test-taking behavior and performance in light 
of the regular admission requirements for the Uni- 
versity of Cr.lifornia and the California State Uni- 
versity. The study verified that the proportion of 
Black and Hispanic students who qualify for regu- 
lar admission to the State's public universities is 
significantly below that of White and Asian stu* 
dents. The study also provided information on dif- 
ferential performance of students from the four ma- 
jor ethnic subgroups relative to the various compo- 



nents of admission requirements - course pattern, 
grades, and test scores. 

University of California requirements 

As Display 30 on page 30 indicates, the most signifi- 
cant barrier preventing Black and Hispanic gradu- 
ates from qualifying for the University of California 
is failure to enroll and complete the University's *'a- 
r course requirements. Only 9.4 percent of all 
Black graduates and 12.3 percent of all Hispanic 
graduates finish high school with most or all of the 
required courses compared to 25.7 percent of White 
graduates and 50.9 percent of Asian graduates. 

The University also has test score and grade-point 
average requirements. As Display 31 illustrates, 
among these pools of graduates who have the sem- 
blance of the required coursework preparation, 51 
percent of the Hispanic gradLates are ineligible be- 
cause they are missing a few *'a-r courses or they 
have grades below "C** in some *'a-r courses. Ap- 
proximately 37 percent of these Black graduates are 
ineligible on this basis while 32 percent of the 
White graduates and 30 percent of the Asian gradu- 
ates are disqualified on this basis. 

Conversely, Blcck graduates with the required 
course work are twice as likely as White graduates 
with this background to be ineligible because their 
high school grade-point averages were below the 
minimum accepted level of 2.78. Hispanic and 
Asian graduates with the required course work 
were less likely than White graduates to be dis- 
qualified because their grade point average was be- 
low 2.78. 

Graduates who earn grade-point averages of 3 3 or 
more in their "a-f courses are eligible for the Uni- 
versity regardless of test scores. Among Hispanic 
graduates who had taken most or all of the required 
"a-r courses, 29 percent earned grade-point aver- 
ages of 3.3 or more compared to 38 percent of the 
Black graduates, 47 percent of the White graduates, 
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DISPLAY 30 Percentage Distribution of 1986 Public High School Graduates by Completion of 
Required "a-/" Curriculum for the University of California by Ethnic Group, Fall 
1986* 



Cnterii 


Asian 


Black 


Hispanic/Latino 


White 


Completed all or most "a-f courses 


50.9 


9.4 


113 


25.7 


Major course^ grades^ and other deficiencies 


49.1 


90.6 


87.7 


74.3 ^ 



The categQiy of qualifying by test results alone was not included in this table because application of the catcgoiy was 
not uniform. 

Source: California Postwcondary Education Commission, 1988. 



DISPLAY 31 Percentage Distribution of 1986 Public High School Graduates Who Had Completed 
All or Most "a-r Courses by Category of Eligibility for Regular Admission to the 
University of California, by Ethnic Group, Fall 1986* 



Eligibility Criteria 


Asian 


Black 


Hispanic/latino 


White 


Eligible: CPA in "a-f courses of 33 or more 


50.9 


37.8 


29.4 


% 

47.2 


Eligible: CPA in *'a-r courses of 2.78 to 3.29 and qualifying test scores 


11.1 


8.9 


9.2 


10.7 


Eligibility indeterminate: GPA of 2.78 to 3.29 but no test scores 


1.9 


33 


1.7 


1.3 


Ineligible: GPA in 'a-P courses of 2.78 to 3.29 but disqualified by test scoies 


5.2 


5.6 


5.9 


4.7 


Ineligible: GPA belov^ 2.78 in "a-f courses 


U 


7.7 


2.5 


3.9 


Ineligible: Minor 'a-f* course and grade deficiencies 


29.6 


36.7 


51.3 


32.2 



♦ The category of qualifying by test results alone was not included in this table because application of the category was not uniform. 
Source: California Postsecondary Education Commission, 1988. 



and 51 percent of the Asian graduates so prepared. 

Test scores become critical iri qualifying for regular 
admission to the University for students who have 
completed the "a-P course requirements and who 
have grade-point averages between 2.78 and 3.3. 
Black graduates in this category were more likely 
than other graduates to have not taken the required 
tests. While 92 percent of White graduates and 90 
percent of Asian and Hispanic graduates, respec- 
tively, in this category, had taken the required 
tests, 81 percent of the Black graduates with the 
course work and grades between 2.78 and 3.3 took 



the SAT or ACT needed to qualify for regular admis- 
sion. Among the students who had taken the re- 
quired tests, 68 percent of the Asian graduates, 69 
percent of the White graduates, and 61 percent of 
the Hispanic and Black graduates qualified for reg- 
ular admission as a result of earning a qualifying 
score on the SAT or the ACT tests. 

Staggering differences exist in the proportions of 
high school graduates from different racial/ethnic 
groups that complete all or most of the University of 
California's required preparatory curriculum. 
Among those graduates who have completed the re- 
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quired courses, Black and Hispanic graduates are 
more likely to have minor course and grade deH- 
ciencies that make them ineligible for regular ad- 
mission. They are also less likely to have earned 
grade-point averages above 3.3 - which would have 
made them eligible regardless of their standardized 
test scores. Among graduates for whom test scores 
are required to qualify for regular admission - 
those with ''a-r grade-point averages between 2.78 
and 3.3 - Black graduates are less likely than other 
graduates to take the tests. While Black and His- 
panic graduates who do take the required tests are 
somewhat less likely to qualify for regular admis- 
sion than are White and Asian graduates, the dif- 
ferential rate» of successfuly qualifying among sub- 
groups are much smaller than those that exist in 
the other categories of eligibility. This information 
reinforces the hypothesis that if students have more 
similar experiences in terms of the nature of their 
high school curriculum and their grade-point 
achievement, disparities among subgroups' eligibil- 
ity for regular admission at the University of Cali- 
fornia would be greatly dissipated. 

California State University requirements 

The regular admj<^sion requirements for the Califor- 
nia State University also include course require- 
ments, grades, and test results. In 1986, the State 
University required the completion of at least five 



of six year-long courses in English and mathematics 
for applicants to qualify for regular admission. As 
Display 32 below illustrates, failure to complete the 
required courses was the primary barrier for His- 
panic graduates to qualify for regular admission to 
the State University. Of all Hispanic high school 
graduates, 44 percent had failed to complete the re- 
quired course work in English and mathematics 
while 34 percent of all White graduates, 31 percent 
of all Black graduates, and 26 percent of all Asian 
graduates were ineligible on this basis. Most of 
these graduates also had not taken any standard- 
ized admission test. 

The single greatest barrier for Black graduates to 
qualify for regular admission was failure to earn 
grade-point averages at or above 2.0. Among Black 
high school graduates, 32 percent had high school 
grade-point averages below 2.0 while 22 percent of 
Hispanic graduates, 14 percent of White graduates 
and 6 percent of Asian graduates earned grade- 
point averages below 2.0. 

Test scores were irrelevant to eligibility determina- 
tions for graduates who completed the required 
courses and earned grade-point averages above 3.1. 
Nearly 40 percent of all Asian graduates in the 
State qi' ilified for regular admission to the State 
University by virtue of completing the required 
courses and earning grade-point averages over 3.1 
compared to 21 percent of White graduates, 10 per- 



DISPLAY 32 Percentage Distribution of 1986 Public High School Graduates by Category of 

Eligibility for Regular Admission to the California State University, by Ethnic Group, 
Fall 1986 



Eligibitity Status 


Asian 


Black 


Hlspanic/I^tino 


White 


Eligible: GPA above 3.1 with courses 


39.3 


5.7 


10.0 


21.4 


Eligible! GPA between 2.0 and 3.1 with courses and qualifying test scores 


10.7 


5.1 


3.3 


102 


Eligibility Indeterminate: GPA between 2.0 and 3.1 with courses but no test scores 


63 


9.4 


11.1 


12.1 


Ineligible: GPA between 2.0 and 3.1 with courses but disqualified by test scores 


12.3 


17.4 


8.9 


8.4 


Ineligible: GPA 2.0 or more without courses or tests 


25.6 


30.8 


44.4 


33.8 


Ineligible: GPA below 2.0 


5.8 


31.6 


22.3 


14.1 



Source: California Postaecondary Education Commisaion, 1986 Eligibility Study. 
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cent of Hispanic graduates, and 6 percent of Black 
graduates. 

Test scores are pivotal in determining eligibility for 
less than 30 percent of the high school graduating 
class - those graduates who have completed the re- 
quired courses and who have grade-point averages 
between 2.0 and 3.1 inclusive. Among graduates 
with these qualifications, Hispanic graduates are 
the least likely to have taken the required test; 52 
percent completed the required tests compared to 61 
percent of White graduates, 70 percent of the Black 
graduates, and 78 percent of the Asian graduates 
with these qualifications. 

Of graduates with these qualifications who did take 
the required tests. Black graduates were the least 
likely to qualify on the basis of their test scores. Ap- 
proximately 23 percent of Black test takers with the 
required course work and grade-point averages be- 
tween 2.0 and 3.1 qualiHed for regular admission to 
the State University compared to 27 percent of His- 
panic test takers, 47 percent of Asien test takers, 
and 55 percent of White test takers in this category. 

The pattern of differences among high school gradu- 
ates from different racial/ethnic subgroups in quali- 
fying for regular admission at the State University 
is similar to that at the University. Taking the re- 
quired courses and earning qualifying grades are 
the greatest barriers for Black and Hispanic gradu- 
ates. However, substantial disparities also exist 
among graduates from different subgroups in suc- 
cessfully qualifying for regular admission on the ba- 
sis of standardized test scores. The data are insuffi- 
cient to determine the reasons for these continued 
large disparities among subgroups. It may be relat- 
ed to the fact that qualifying grade-point averages 
ara not based on the required curriculum but in- 
."^tead on all course work. It may bo that the range of 
qualifying; grades is so broad that it encompasses a 
a large number of students whose life goals are 
loosely related to continued educational achieve- 
ment. It may be that the relation between success- 
ful test performance is highly related to high school 
grades, and as grades approach 2.0 the likelihood of 
success declines disproportionately. Further inves- 
tigation of these relationships is needed before per- 
tinent public policies can be proposed. 



Conclusions and recommendations 

By design^ standardized tests are intended to assist 
in the decision to admit or exclude students from 
regular admission to collego. The controversy 
arises from the fact, as repeatedly documented in 
this report, that students from certain ethnic sub- 
groups are disproportionately likely to earn scores 
which disqualify them for regular admission to the 
University and State University. In addition, stu- 
dents from these same subgroups are less likely 
than average to participate in these tests. But be- 
fore the issue of whether tests create inappropriate 
barriers for some students can be resolved or even 
discussed, a definition of '^inappropriate" is re- 
quired. 

Validity of admissions criteria 
and use of eligibility indexes 

The segmental eligibility indexes that combine 
grades and test scores to determine eligibility were 
designed to identify those students with the great- 
est probability of succeeding at the institution. 
However, no recent information on the predictive 
validity of these selection criteria for the State's 
public universities is available. Thus, before the is- 
sue of inappropriateness can be resolved, the Uni- 
versity of California and the California State Uni- 
versity should conduct validity studies of their ad- 
mission criteria, including the role of test scores. At 
the same time, they should review the operational 
use of their eligibility indexes to insure proper con- 
sideration of the tests' standard errors of measure- 
ment when assessing individual applicant's eligibil- 
ity. They should then submit information on the 
predictive validity of their admission's require- 
ments and summary of their review of current ad- 
mission practices by November 15, 1991, so that the 
Commission may include this information in its 
next report on standardized testing in California. 

Non-test takers and test preparation 

Differences in the proportion of graduates from dif- 
ferent ethnic subgroups who do not take the re- 
quired tests even when they appear to be otherwise 
qualified intimates another type of barrier to eligi- 
bility. The causes of this barrier are not well under- 
stood either. Do these students not take admission 



tests because (1) their postsecondary education aiv 
pirations do not require them, (2) their friend^/ aV i' 
not taking the test, (3) the application and fee waiv- 
er process is too confusing, (4) they have to work 
and can't take time to take the test, (5) their parents 
don't value or can't afford to pay for it, (6) they don't 
know about the tests or that they are required, or 
(7) the test site is too difficult to get to. Obviously, 
this list is not exhaustive, and it is intended to illus- 
trate the lack of understanding that exists in this 
area. 

Another related issue is opportunity to prepare for 
the test. With university admissions becoming in- 
creasingly competitive, having the competitive ad- 
vantage of high test scores is an opportunity stu- 
dents and their parents are willing to invest in. 
Thus, a whole industry devoted to standardized test 
coaching and preparation has arisen. Certainly, the 
financial ability to take advantage of these opportu- 
nities are not equitably distributed among the high 
school population. While the variation in type and 
level of test preparation is more closely related to 
socioeconomic status, the correlation between race 
and SES cause this issue to be pertinent to the cur- 
rent discussion. 

These two issues are areas that the Commission 
must review in greater detail over the next two 
years to determine what, if any, aspect of them con- 
stitute inappropriate barriers and what methods 
might be available to ameliorate their impact. 
These are not new issues but have been concerns for 
as long as tests have played a pivotal role in eligibil- 
ity determinations. Not surprisingly, considerable 
effort by schools, universities, and test sponsors has 
been undertaken to ensure more equitable postsec- 
ondary educational opportunities with these issues 
in mind. 

Cooperative strategies 

Data from the Commission's 1986 Eligibility Study 
suggests that the more comprehensive the studenti/ 
curricular preparation and the stronger their aca- 
demic performance in terms of grade-point aver- 
ages, less differential exists among students from 
different ethnic groups in their likelihood of quali- 
fying for regular admission. So the arena that pro- 
vides the greatest opportimities for improving eligi- 
bility of Black and Hispanic students is insuring 
that they have equitable opportunities to complete 



successfully the required college preparatory cur* 
riculum. 

The development of standardizp'l tests arose from 
the cooperative efforts of educators to articulate the 
nature of pre-coUegiate curricular preparation. In 
recent years in California, the State's public univer- 
sities have clearly articulated the range of courses 
and level of achievement that they believe neces* 
sary for successful academic performance in college. 
In spite of this increased uniformity of curricular re- 
quirements in high school, the proportions of stu- 
dents from various ethnic subgroups who complete 
the full set of admission course requirements varies 
considerably. While having the curricular pattern 
of preparation reduces the test score disparities 
among students from various subgroups. Black and 
Hispanic students continue to have somewhat lower 
test scores even when their course preparation is 
the same. From these findings arise concerns about 
the fairness of the test and about the true compara- 
bility of preparation not just in terms of course titles 
but also in terms of the rigor and thoroughness with 
which the course subject matter is covered. 

Test sponsors have sought to understand the 
sources of these disparities and remove the ones 
that are inappropriate. A statistical procedure, dif- 
ferential item functioning, has been implemented 
that identifies test items which appear to systemati- 
cally discriminate between sets of test takers not on 
the basis of knowledge or skill, but by the individ- 
ual's sex or ethnic group membership, making these 
items prime candidates for replacement. These ef- 
forts to remove possible cultural and gender bias in 
these tests are crucial contributions toward insur- 
ing equitable opportunities for all students. 

Test sponsLfs have been involved in recent cooper- 
ative interinstitutional and intersegmental efforts 
to define and implement pre-coUegiate curricula 
through which students gain the knowledge and 
skills needed to obtain the full benefits of higher 
education. An example of such an effort is the Col- 
lege Board's '^Educational EQuality Project," which 
seeks to strengthen the academic quality of second- 
ary education and insure equal access to postsec- 
ondary education for all students. This project is a 
national effort and its role and impact in California 
will require further research. 

Test sponsors have also been involved in efforts to 
improve opportunities for students to take the re- 
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quired tests through informational programs, fee 
waiver options, and direct pilo^ programs in schools 
with large minority enrollments. An example of 
this latter activity was the American College Test- 
ing Program's work with high schools in the Ba- 
kersfleld area providing information, assessment 
services and fee waivers for students to take the 
ACT. Between 1985 and 1989, the Program provided 
approximately 9,000 free ACT tests to high school ju- 
niors in Kern District. An evaluation of this type of 
effort's contribution toward improving opportuni- 
ties for regular admission of Biack, Hispanic, and 
American Indian students in California needs fur- 
ther review. 

A myriad of intersegmental student preparation 
programs exist in California. In general, these pro- 
grams seek to improve the preparation of secondary 
school students for college and university study. 
One of these projects - the College Admission Test 
Preparation Pilot Project, established by AB 2321 
(Tanner) - seeks to increase the number of students 
from economically disadvantaged and ethnic minor- 
ity groups in four-year colleges and universities by 
increasing college admission test taking, admission 
test performance^ and college aspirations among 
these students. An integral component of these pi- 



lot projects is also completion of all "a-f ' course re- 
quirements at higher levels of performance. 

The data on the impact of the projects on test- taking 
rates, as presented in the projects' 1987-88 evalua- 
tion report, are inconclusive. The Commission ex- 
pects to complete its comprehensive review of all in- 
tersegmental student preparation programs in 
1991. Information from that review that highlights 
effective cooperative strategies related to students' 
participation and performance on standardized 
tests will be included in the Commission's 1992 re- 
port on these tests. 

A major task for the Commission in preparation for 
that report will be to review all of these efforts in or- 
der to identify those amenable to public policy inter- 
vention. In addition, the Commission, with the co- 
operation of the State's two public universities, will 
seek to define what constitutes an inappropriate 
barrier to regular admission by examining validity 
studies of their eligibility criteria. The Commission 
expects that it will have the necessary information 
to identify in its 1992 report those public policy ini- 
tiatives that are needed in the area of standardized 
testing if California's multiethnic society is to en- 
sure equitable and excellent postsecondary educa- 
tion opportunities for all its citizens. 



■1 'J 



Appendix A: Senate Bill 1416 (Torres, 1989) 



Senate BUI No. 1416 



CHAPTER 446 

An act to amend Sections 99153 and 99155 of the Education Code» 
relating to education* 

(Approved by Coveraor September 13, 1989. Filed with 
Secretary of State September 13» 1969.] 

LEGISLATIVE COUNSEL'S DIGEST 

SB 1416, Torres. Postsecondary education: standardized tests. 

Existing law requires the test sponsor of standardized tests which 
are used for the purposes of admissions to, or class placement in, 
postsecondary educational institutions or their programs, or 
preliminary preparation for those standardized tests, to submit 
specified da«a and information to the California Postsecondary 
Education Commission. 

This bill, in addition, would require the test sponsor of 
standardized tests to supply to the commission any other ii^rmation 
mutually identified by the conunission and the test sponsor that will 
be reasonably available and helpful in assessing the state's progress 
in increasing the number of Hispanic, Black, or American Indian 
students to enroll in the University of California or the California 
State University and developing strategies to expand access to 
college for those students. 

Existing law requires the California Postsecondary Education 
Conmiission to prepare and submit an annual report regarding 
standmlized tests of the state's test subject to the Governor, the 
Legislature, the governing entity of each of the 3 segments of public 
postsecondary education, itself, and the Superintendent of Public 
Instruction, as specified. 

This bill would require the commission to prepare and submit by 
May 1, 1990, and every 2 years thereafter, a biennial report that 
includes the information required under existing law, as well as the 
number of California students, by ethnicity and gender, who 
participate in advance placement classes in secondary schools, and 
take preliminary standardized college admissions tests. This bill 
would require the commission to report on the progress in increasing 
the number of Hispanic, Black, and American Indian students who 
graduate from high school and who are eligible to enroll in the 
University of California and the California State University and to 
present recommendations, as specified. 

The people of the State of California do enact as follows: 

SECTION 1. Section 99153 Oi* the Education Code is amended to 

read: 
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99153. On or before November 15 of each year, the test sponsor 
shall submit to the commission all of the following data and 
information: , 

(a) Three copies of each version of the test which was disclosed 
in the prior testing year, along with the corresponding acceptable 
answers, and the methods used to convert raw scores mto the test 
scores reported to test subjects and test score recipients, together 
with an explanation of that method. 

(b) The dates of mnjor or national administration of each test 
administered by the test agency during the testing year. 

(c) The total number of test subjects who have taken the test 
once, who have taken it twice, and who have taken it more than 
twice during the testing year. . . , 

(d) The total number of test subjects who registered for, but did 
not take, the test. 

(e) The total amount of fees received from test subjects by the test 
agency for the test (or that testing year. 

(f) The expenses to the test sponsor of the test, as follows: 

(1) Those expenses which are directly attributable to the test. 

(2) Those expenses which are indirectly attributable to the test 
However, if the test sponsor also sponsors another test or related 
activities, it shall be sufficient for compliance with this section for the 
test sponsor to list indirectiy attributable expenses, to the extent that 
they are identifiable, as they are proportionately related to the test. 
The test sponsor shall also list expenses indirectiy attributable to all 
activities of the test's sponsor, including expenses not identifiable as 
attributable to a test. . 

The finflfi^al disclosure required by this section shall be submitted 
within 135 days after the close of the testing year and in sufficient 
detail to indicate the m^jor categories of revenues and expenses 
associated with the test. Except as provided in this section, the 
information for different tests administered by the same test sponsor 
shall be reported separately and by individual test. 

(g) A copy of all documents, pamphlets, and literature provided 
to the test subject and the test score recipient 

(h) Where applicable, the national average test scores, state 
average test scores, the standard error of measurement, and any 
othor existing information relevant to a comparison of the test scores 
of the state's test subjects with test scores of previous test subjects of 
the past five years. 

(i) For those tests used to predict academic performance, the 
most recent national or regional aggregation of date concerning the 
predictive validity of all of the following: 

(1) Academic record or grades alone. 

(2) Standardized test score alone. 

(3) Academic record and test score combined. 

(4) Standardized test scores over and above the predictive 
validity of academic record alone. 
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(j) Using available data, the racial, ethnic, and sex breakdown of 
all test subjects taking each test during the testing year. 

(k) If a separate fee is charged test subjects for admissions data 
assembly service, the test sponsor shall report information 
concerning the data assembly service in substantially the same form 
as would be required for a test under this section. 

(/ ) The test sponsor shall also supply to the commission any other 
information mutually identified by the commission and the test 
sponsor that will be reasonably available and helpful in either (1) 
assessing the state*s progress in increasing the number of Hispanic, 
Black, or American Indian students who graduate from high school 
eligible to enroll in either the University of California or the 
Ccdifomia State University or (2) developing strategies to involve 
the testing companies in cooperative actions with schools, colleges, 
and universities to expand access to college for Hispanic, Black, and 
American Indian studenti 

(m) lliis section shaU not be construed to reqtiire any test agency 
to submit to the commission any rep jrto or documents containing 
information relating to any individual test subject Any information 
relating to any individual test subiect shall be deleted or obliterated 
from any reports or documents fUed with the commission pursuant 
to this section* 

(n) This section shall not apply to any standardized test which is 
adii^nistered to fewer than 3v900 test subjects in California during a 
testing year. 

SEC 2. Section 99155 of the Education Code is amended to read: 
99155. By May 1, 1990, and every two year^ thereafter, the 
commission shall prepare and submit a biennial report regarding 
standardized tests of the state's test subjects to the Governor, the 
Legislature, the Regents of the University of California, the Board of 
Governors of the California Community Colleges, the Trustees of the 
California State University, and the Superintendent of Public 
Instruction* This report shall include a descriptive summary of 
existing data and information submitted to the conunission pursuant 
to Section 99153, including all of the following: 

(a) The number of California students taking standardized tests. 

(b) The performance of California test subjects. 

(c) The number of California students, ')y ethnicity and gender, 
who participate in advance placement classes in secondary schools 
and take preliminary standardized college admission tests. 

(d) The predictive validity of test scores as specified in subdivision 
(i) of Section 99153. 

(e) A description of the information specified in subdivisions (a) , 
(b), and (d) according to the sex and ethnicity of test subjects. 

(f) The revenues received by test sponsors, and the proportion of 
those revenues expended for test development and administration. 

The conmiission shall also report on the progress in increasing the 
number of Hispanic, Black, and American Indian students who 
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graduate from high school eligible to enroll in either the University 
of California or the California State University. The testing 
companies'^shall cooperate with the commission in the sharing of 
avaihible information and the development of policy 
recommendations for strengthening the college preparatory 
curriculum and increasing the availability of test preparation 
activities for students from ethnic groups traditionaUy 
underrepresented in postsecondary education. The commission shall 
present specific reconunendations on (1) methods to remove the 
inappropriate obstacles that standardized college admissions tests 
may provide in precluding some students from obtaining regular 
admission to public colleges and universities and (2) strategies to 
involve the testing companies in cooperative actions with the 
schools, colleges, and universities to expand access to college for 
Hispanic, Black, and American Indian students. 
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Appendix B: Test Sponsor Materials 



Preliminary Scholastic Aptitude Test/National Merit 



Scholarship Qualifying Test (PSAT/NMSQT) 41 

Scholastic Aptitude Test 47 

College Board Achievement Tests 53 

American College Test 57 

Advanced Placement Examinations 61 

Test of English as a Foreign Language 73 

Graduate Record Examinations 89 

Graduate Management Admission Test 109 

Law School Admission Test 117 

Medical College Admission Test 127 
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November 2, 1989 



ERIC 



Dr. Noriuan Charles 
Assistant Director 

California Postsecondary Education Commission 
1020 Twelfth Street 
S ac r amen t o t CA 95814 

Dear Dr. Charles: 

Education Code Section 99151 requires the College fioardt as a test 
sponsor, to file with the Commission certain information specified 
in Section 99153* The enclosed information is for the Preliminary 
Scholastic Aptitude Test/National Merit Scholarship Qualifying 
Test. 

Sincerely 9 



John Vaccaro 
Director 

Admissions and Guidance Services 

JV/ls 

Enclosures : 

(1) Section (c)(d) Teat Taking Pattern Information 
(1) Section (e)(f) Financial Information 
(3) Form S, October 15, 1988, PSAT/NMSQT 
(3) Form T, October 18, 1988, PSAT/NMSQT 

(1) Answer Keys for Form S and Form T of the 1988 PSAT/NMSQT 

(1) Student Bulletin, 1988 PSAT/NMSQT 

(1) About Your 1988 PSAT/NMSQT 

(1) 1988 PSAT/NMSQT Supervisor's Manual 

(1) 1988 PSAT/NMSQT Interpretive Manual 

(1) Working with the PSAT/NMSQT 

(1) PSAT/NMSQT Summary Report for National, Regional and 

California College Board Juniors, 1988 
(1) Announcement of 1988-89 Test Dates 

(1) 1988 PSAT/NMSQT California Summary Reports by Ethnic 
Background 
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^ nonproTii educational association serving studentSt schoois, and colleges through programs designed to expand educational opportunity 



THE COLLEGE BOARD 



Report to the California Postsecondary Education 
Commission Pursuant to California Education Code (Senate Bill 1758 - Torres) 

State of California 



The following Information Is provided In compliance with Section 99153 (c) (d). 

This data Is based on a11 national and International test administrations of 
the PRELIMINARY SCHOLASTIC APTITUDE TEST/NATIONAL MERIT SCHOURSHIP QUALIFYING 
TEST during the 1988-89 testing year. 



PSAT/NMSQT 
IfiSl 



The total number of times the 
taken during the testing year 



test was 



1,529,948 



The number of Individuals who 
the test 



took 



Once 
Twice 

More than twice 



1,529,948 
-0- 
-0- 



The number of Individuals who 
for but did not take the test 



registered 



N/A* 



*The PSAT/NMSQT Is school -administered; therefore, students do 
not register Individually. 



October 12, 1989 



RFM/lc 
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Torres Report For Year Ended June 30. 1989 
The following Information Is provided In compliance with Section 99153 (e) 

P§AT/NH?OT TEST 



Fees received from test takers In 
the College Board's PSAT/NNSQT Test 

Test Fees 



t 8.138.831 



The following Information Is provided In compliance with Section 99153 (f) 

PSAT/NMSQT TEST 



Expenses directly Attributable 
to the PSAT/NMSQT Test 

Cost of Test Administration 

Direct support of test administration: 
publications, transcript services, etc. 

Program direction 



Expenses indirectly attributable 
to the PSAT/NMSQT TEST 

Support services: publications 
regional offices, etc. 

Associational and Administrative 
expense 

Research and Development 



Total expense directly and Indirectly 
attributable to PSAT/NMSQT test 



$ 859,494 

753,636 

S 2. 594. 896 
PSAT/NMSQT TEST 



$ 634,000 



231,000 
151.336 



$ 3.611.232 



Torres Report for Year Ended June 30. 1989 



Expenses Identifiable as Scholastic Aptitude Test, Achlevemnet Test, PSAT/NMSQT 
Test and Advanced Placement Tests have been allocated thereto. Joint costs 
have been allocated based on the Test volumes Involved. 

The following Information Is also provided In compliance with Section 99153 (f) 

Tq U I 

Total expense attributable to all 
activities Including expenses not 
Identifiable as attributable to 
the test 

Support services: publications, 

general offices, etc. $10,977,558 
Assoclatlonal and administrative 

expense 13,263,339 

Research and Development 3.970.005 

$ 28.210.902 
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November 2i 1989 



Dr. Norman Charles 
Assistant Director 

California Postsecondary Education Commission 
1020 Twelfth Street 
Sacramento , CA 93814 

Dear Dr. Charles: 

Education Code Section 99151 requires the College Board, as a test 
sponsor, to file with the Commission certain information specified 
in Section 99153. The enclosed information is for the Scholastic 
Aptitude Test and the College Board Achievement Tests. 

Sincerely, 

John Vaccaro 
Director 

Admissions and Guidance Services 

. JV/ls 
Enclosures : 

(1) Section 99153 (c)(d) Test Taking Pattern Information 
(1) Section 99153 le){f) Financial Information 
(3) 5 SATs, 1989 Edition* 

(1) Registration Bulletin, SAT and Achievement Tests, 1989-90 

( 1 ) Taking the SAT 

(1) Taking the Achievement Tests 

(1) Using Your College Planning Report, 1989-90 

( 1 ) 1989-90 ATP Guide 

(1) Guidelines on the Uses of College Board Test Scores and 

Related Data 
(1) Announcement of 1988-89 Test Dates 

(1) California Report, College Bound Seniors, 1989 Profile 
(1) National Report, College Bound Seniors, 1989 Profile 



*1 enclosed; 2 to be forwarded under separate cover when available* 
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A nonprofit educational association serving students, schools* and colleges through programs designed to expand educational opportunity 



THE COLLEGE BOARD 



Report to the California Postsecondary Education 
Commission Pursuant to California Education Code (Senate Bill 1758 - Torres) 

State of California 



The following Inrormatlon Is provided In compliance with Section 99153 (c) (d). 

This data Is based on all national and International test administrations of 
the Scholastic Aptitude Test during the 1988-89 testing year. 



Scholastic 
Aptitude 
Test 



The total number of times the test was 
taken during the testing year 



1,992,813 



The 
the 



number of Individuals who took 
test 



Once 
Twice 

More than twice 



1,531,298 
201,239 
18,869 



The 
for 



number of Individuals who registered 
but did not take the test 



165,928 



October 4 



1989 



RFM/lc 
1379T 
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Torres Report For Year Ended June 30. 1989 
The following Information Is provided In compliance with Section 99153 (e) 



Fees received from test takers In 
the College Board's SCHOUSTIC 
APTITUDE TEST 

Test Fees 

Transcripts, Score Reports, etc. 



Scholastic 
Aptitude Test 



$25,909,000 
S 15.998.543 
^41.907.543 



The following Information Is provided In compliance with Section 99153 (f) 



Expenses directly Attributable 
to the SCHOLASTIC APTITUDE TEST 

Test development, analysis and 
validation 

Cost of Test Administration 

Direct support of test administration: 
publications, transcript services, etc. 

Summary reporting services 

Program direction 



Expenses Indirectly attributable 
to the SCHOLASTIC APTITUDE TEST 

Support services: publications 
regional offices, etc. 

Assoclatlonal and Administrative 
expense 

Research and Development 



Scholastic 
Aptitude Test 



$ 3,272,717 
19,164,694 

13,506,401 
454,009 

ISLm 

"7.179.827 

Scholastic 
Aptitude Test 



$ 2,090,165 



2.796,930 

510,2 37 

^ 5.397.332 



Total expense directly and indirectly 
attributable to SCHOLASTIC APTITUDE TEST 



S 42.577.159 



Torres Report for Year Ended June 30. 1989 



Expenses Identifiable as Scholastic Aptitude Test, Achievement Test, PSAT/NMSQT 
Test and Advanced Placement Tests have been allocated thereto. Joint costs 
have been allocated based on the Test volumes Involved. 

The following Information Is also provided In compliance with Section 99153 (f) 



Total expense attributable to all 
activities Including expenses not 
Identifiable as attributable to 
the test 

Support services: publications. 



general offices, etc. 



$10,977,558 



Associatlonal and administrative 
expense 



13,263,339 



Research and Development 



3 » 970 1 005 
S 28.210.902 



THE COLLEGE BOARD 



Report to the California Postsecondary Education 
Conmlsslon Pursuant to California Education Code (Senate Bill 1758 - Torres) 

State of California 



The following Information Is provided In compliance with Section 99153 (c) (d). 

This data Is based on all national and International test administrations of 
the Achievement Tests during the 1988^89 testing year. 



Achievement 



The total number of times the test was 
taken during the testing year 



315,541 



The number of individuals who took 
the test 



Once 
Twice 

Here than twice 



283,425 
15,230 
546 



The number of individuals who registered 
for but did not take the test 



29,907 



October 12, 1989 



RFM/lc 
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Torres Report For Year Ended June 30. 1989 
The following Information Is provided In compliance with Section 99153 (e) 



Fees received from test takers In 
the College Board's ACHIEVEMENT 
TESTS 

Test Fees 

Transcripts, Score Reports, etc. 



Achievement 



$ 6,320,000 
2.604.414 



The following Information Is provided In compliance with Section 99153 (f) 



Expenses directly Attributable 
to the ACHIEVEMENT TESTS 

Test development, analysis and 
validation 

Cost of Test Administration 

Direct support of test administration: 
publications, transcript services, etc. 

Summary reporting services 

Program direction 



Expenses Indirectly attributable 
to the ACHIEVEMENT TESTS 

Support services: publications 
regional offices, etc. 

Assoclatlonal and Administrative 
expense 

Research and Development 



Total expense directly and indirectly 
attributable to ACHIEVEMENT TESTS 



Achievement 
TgSt? 



$ 2,439,542 
3,772,089 

2,018,424 

454,001 

127.304 
i 8.811.260 

Achievement 
Tests 



$ 340,259 
656.070 



Torres Report for Year Ended June 30. 1989 



Expenses Identifiable as Scholastic Aptitude Test, Achievement Tests, 
PSAT/NHSQT Test and Advanced Placement Tests have been allocated thereto. 
Joint costs have been allocated based on the Test volumes Involved. 

The following Information Is also provided in compliance with Section 99153 (f) 

Total 

Total expense attributable to all 
activities including expenses not 
identifiable as attributable to 
the test 

Support services: publications, 

general offices, etc. $10,977,558 
Associational and administrative 

expense 13,263,339 

Research and Development 3.970.005 

$ 28.210.902 
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October 30, 1989 




Horace F. Crandell 

Postsecondary Education Administrator 
California Postsecondary Education Commission 
1020 12th Street, Second Floor 
Sacramento, CA 95814 



Dear Mr. Crandell: 

In compliance with the California Education Code, Part 65, Chapter 3, related 
to standardized testing. The American College Testing Program, Inc. (ACT) 

hereby files the prescribed information as required by law for the testing 
year September 1, 1988 through August 31, 1989: 

(1) Total tests taken during the testing year 1,391,378 

Individuals taking the test once 521,964 

Individuals taking the test twice 340,089 

Individuals taking the test more than twice 58,950 

Individuals who registered but did not take the test 130,033 

Total amount of fees received from test subjects $21, 286,834 

Direct expense for testing program: 

Test Adm., Scoring and Reporting $12,690,147 

Research and Development 1,944,458 
Secondary & Postsecondary Institutions 

Support Services 2, 924, 502 

Program Administration ?j9'??^ 

Total Direct Expense ^[57499, 327 

Indirect Expenses $ 2,271.468 



(2) ACT does not offer an admissions data assembly service. 

(3) Copies of each general publication prepared for routine distribution 
to test subjects and test score recipients are enclosed. 

(4) Research data pertaining to test scores for California and the nation 
are enclosed. Research reports that have not been updated since our 
last filing have not been repeated with this filing. 




2201 North Oodga Strwt P O, Box 168 

Iowa City, Iowa 52243 ^ 

(319) 337-1000 ' 



Horace Crandell 
October 31, 1989 
Page Two 



(5) Copies of each general publication prepared for routine distribution 
to ACT participating colleges and universities are also enclosed. 

This completes our filing for the 1988-89 testing year. Please let me 
know If additional materials are required under the law. 

Sincerely, 



Joseph B. Pffgh 
Vice President 




JBP: js 
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EXHIBITS 



Exhibits A-1 
through A-3: 



Exhibit B: 



Three copies of each version of the ACT Assessment disclosed 
during the 1988-89 testing year, along with the correspond- 
ing answers, the methods used to convert raw scores into 
test scores, and an explanation of the method used. 
(Forms 28E, 28F, and 29B) 

Registering for the ACT Assessment (combined East/West 
Regions) Contains: 

a. The dates of national administration of the ACT 
Assessment (page 1) 

b. Registration information (page 1) 

c. Score reporting information (pages 1 & 2) 

d. The ACT Interest Inventory (page 5) 

e. The Student Profile Section (pages 6-10) 



Exhibit 


C: 


Preparing for the ACT Assessment 


Exhibit 


0: 


Using Your ACT Assessment Res'ults 


Exhibit 


E: 


Contends of the Tests in the ACT Assessment 


Exhibit 


F: 


ACT Assessment Student Information 


Exhibit 


G: 


Using the ACT Assessment on Campus 


Exhibit 


H: 


Counselor's Handbook 


Exhibit 


I: 


The ACT Assessment Test Preparation Reference Manual for 
Teachers and Counselors 


Exhibit 


J: 


Reporting Services for Colleges and Universities 


Exhibit 


K: 


Research and Information Services 


Exhibit 


L: 


Helping Students Grow 


Exhibit 


M: 


Education Opportunity Service 


Exhibit 


N: 


Request for ACT Assessment Special Testing 


Exhibit 


0: 


High School Profile Report Composite for California and 
National Composite 


Exhibit 


P: 


Trend Tables for ACT-Tested Students in California (contains 
racial/ethnic, sex, etCv breakdown) 


Exhibit 


Q: 


ACT Class Profile Report - National Norms 


Exhibit 


R: 


College Student Profiles - jiorms for ACT Assessment 
Research Services Summary Tables (1985-86, 1986-87, 1987-88) 


Exhibit 


S: 



ERIC 



59 



WMlwn R«gloml Office 



■>':>^'^ Th« Coil«fl« Bowtl 
' I Sum* 48a 2099 QMmmt Pltc« 

^ . .! San JoM,C««lfOfnla 95110*1017 
(406) 452-1400 
PAX: (408) 463-7398 



November 2, 1989 



Dr. Norman Charles 
Assistant Director 
California Postsecondary 
1020 Twelfth Street 
Sacramento, CA 95814 



Education Commission 



Dear Dr. Charles: 



Education Code Section 99151 requires the College Board, as a test 
sponsor I to file with the Commission certain information specified 
in Section 99153. The enclosed information is for the Advanced 
Placement exami na t i ons . 



Sincerely, 




fohn Vaccaro 
Director 

Admissions and Guidance Services 



JV/ls 

Enclosures : 

(1) Section 99153 {c){d) Test Taking Pattern Information 
(1) Section 99153 (e)(f) Financial Information 

(1) Bulletin for Students, Advanced Placement Program, May 1990 
(1) A Guide to the Advanced Placement Program, May 1990 
(1) 1989 Coordinator's Manual, AP Exams (May 8-12, 15-19, 1989) 
(1) School Administrator's Guide to the Advanced Placement 
Program 

(1) 1989 AP National and California Summary Reports (available 

December 1989 )« 
(1) 1990 Teat Dates, Advanced Placement Examination 
(1) Advanced Placement Yearbook, 1989 



*To be forwarded under separate cover December 1989 
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^uaBKait ecjiucatlonal association serving studentSt schools* ar J colleges through programs designed to expand educational opportunity 



THE COLLEGE BOARD 



Report to the California Postsecondary Education 
Commission Pursuant to California Education Code (Senate Bill 1758 - Torres) 

State of California 



The following Information Is provided In compliance with Section 99153 (c) (d). 

This data Is based on all national and International test administrations of 
the Advanced Placement Program during the 1988-89 testing year. 



Advanced 
PI acement 
Examination 




total number of times the examination 
taken during the testing year 



463,000 



The 
the 



number of Individuals who took 
examination 



Once 
Twice 

More than twice 



463,000 
-0- 
-0- 



The 
for 



number of Individuals who registered 
but did not take the examination 



N/A** 



'**AJvanced Placement students register at 
time of the examination administration. 



October 12 » 1989 



RFM/lc 
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Torres Report For Year Ended June 30. 1989 
The following Information Is provided In compliance with Section 99153 (e) 



Fees received from examination takers In 
the College Board's ADVANCED PLACEMENT 
PROGRAM (APP) 

Examination Fees 



ADVANCED PLACEMENT PROGRAM 



$23,285,803 



The following Information Is provided In compliance with Section 99153 (f) 



Expenses directly attributable 
to the ADVANCED PLACEMENT PROGRAM 

Examination development, analysis and 
validation 

Cost of Examination Administration 

Direct support of examination administration: 
publications, transcript services, essay 
readings, etc. 

Program Direction 



ADVANCED PLACE MENT PROGRAM 



$ 2,791,931 
",570,670 

2,345,814 

987.178 
^15.695.593 



Expenses Indirectly attributable 
to the ADVANCED PLACEMENT PROGRAM 

Support services: publications 
regional offices, etc. 

Assoclatlonal and Administrative 
expense 

Research and Development 



ADVANCED PLAC EMENT PROGRAM 



$ 2,626,272 



1,333,000 
5QQ,329 

$ 4.459.600 



Total expense directly and indirectly 
attributable to ADVANCE PLACEMENT PROGRAM 



S 20.155.193 



Torres Report for Year Ended June 30. 1989 



Expenses Identifiable as Scholastic Aptitude Test, Achievement Test, PSAT/NMSQT 
Test and Advanced Placement Tests have been allocated thereto. Joint costs 
have been allocated based on the Test volumes Involved. 

The following Information Is also provided In compliance with Section 99153 (f) 

Total 

Total expense attributable to all 
activities Including expenses not 
Identifiable as attributable to 
the test 

Support services: publications, 

general offices, etc. $10,977,558 
Assoclatlonal and administrative 

expense 13,263,339 

Research and Development 3.970.005 

^28.210.902 
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99153. On or b«for« Nov«inb«r 15 of aach y«ar, th« t«st sponsor 
■hall aubiBlt to tha Coonlaalon all of tha following data and 
informationt 

(a) Thr«« copiaa of aach varaion of tha taat which wara diacloaad 
in tha prior tasting y«ar# along with tha corrasponding accaptabla 
answarSf and tha nathods usad to eonvart raw scoras into tha tast scoras 
raportad to tast subjacts and tast scora racipiants, togathar with an 
axplanation of that aathod. 



99153. (a) Inclosad ara thraa copias of aach of tha tatft forms 
usad at tha (1) Octobar 22, 1988, (2) March 11, 1989, and (3) May 13, 
1989 Xntamational TOIPL tast adninistrations and thraa copias of aach 
of tha tast forms usad at tha (1) Saptambar 16, 1988 and (2) Fabruary 
10, 1989 Spaoial Cantar TOIFL tast administrations. Also includad ara 
cassatta racordings of tha stimulus matarial for tha listaning 
comprahansion saction, tha corract ans%#ars for aach tast form and tha 
scora convarsion tablas. 

Thasa tast forms ara aquivalant tr thosa usad at aach TOEFL 
administration, but thay ara no longar in usa as sacura tasts. 
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99153. (b) Thm datM of major or national administration of aach 
tast adminiatarad by tha taat aganc; during tha taating yaar. 

(c) Tha total numbar of taat aubjacta who hava takan tha taat 
onca, who hava takan it twica, and who hava takan it mora than twica 
during tha taating yaar. 

(d) Tha total numbar of taat aubjacta who ragiatarad for, but did 
not taka, tha taat* 

(a) Tha total amount a of faaa racaivad from taat aubjacta by tha 
taat agancy for taat for that taating yaar. 

(f) Tha axpanaaa to tha taat aponaor of tha taat, aa folloua: 

(1) Thoaa axpanaaa which ara diractly attributad to tha taat. 

(2) Thoaa axpanaaa which ara indiractly attributad to tha 
taat. 

(g) h copy of all documnnta, pamphlata, and litaratura providad to 
tha taat aubjact and tha taaw acora racipiant. 

(h) whara applicabla, tha national avaraga taat acoraa# atata 
avaraga taat acoraa, tha atandard arror of maaauramant# and any othar 
axiating information ralavant to a comparison of tha taat acoraa of tha 
atata^a taat aubjacta with taat acoraa of pravioua taat aubjacta of tha 
past fiva yaara* 

(i) For thoaa taata uaad to pradict acadamic parformanca •••• 

(j) Uaing availabla data, tha racial, athnic, and aax braakdown of 
all taat aubjacta taking aach taat during tha taating yaar. 

<k) If a saparata faa ia chargad taat aubjacta for admiaaiona data 
assambly sarvica 

(1) Tha proviaions of thia aaction ahall not ba conatruad to 
raguira any taat agancy to submit to tha Commiaaion any raporta or 
documanta containing information ralating to any raporta or documants 
fila>^ with tha Commiaaion purauant to thia aaction. 



99153. (b) Tha dataa of major or national adminiatrations of 
TOIFL ara aa followat 

Tha Zntamational Taating Program which alwaya tasts on a Saturday 
providaa taating aix tlmas a yaar at approximataly 1,200 taat cantara 
aatabliahad by BTS throughout tha world. Taat dataa in 1988-89 wara: 
Auguat 6, 1988; Octobar 22, 1988; Novambar 19^ 1988; January 14, 1989; 
March 11, 1989; and May 13, 1989. 
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Th« Special Centar Tasting Program achadulaa taat adminiatrationa 
on Friday a at uaually tha aama taat cantara aa tha Zntar national 
program. Tha program waa intagratad with tha Zntamational TOEFL 
taating program in 1979 to proTida monthly taa>:ing with altamata Friday 
and Saturday taat dataa. Taating waa conduct ad throughout tha world in 
1988-89 tot thia program on July 8, 1988, SaptaadMir 16, 1988, Dacambar 
9« 1988, Fabruary 10, 1989, April 14, 1989, and Juna 2, 1989. 

(c) ITS raeorda praparad by tha Anawar Shaat Scanning Dapartroant 
indicata tha Taat of Ingliah aa a Foraign Languaga (TOIFL) waa takan 
578,722 timaa during 1988-89. Of this total 98,615 wara anawar ahaata 
aant to ITS for scoring undar ifca Znatitutional Tasting prograna. It is 
poaaibla additional teat aubjaota took tha TOIFL undar thia aarvica and 
tha anawar ahaata wara aeorad by tha taating inatitution. Such taat 
subject a are not recorded at STS. 

Information on the number of timaa an individual haa taken TOEFL 
during the teating year ia collected on the regiatration form. Tha 
information ia aelf-reported and cannot be verified by ETS. Thoae 
individuala who applied to take TOEFL during 1988-89 and who provided 
thia information are diatributed aa followai 



(d) In 1988-89, 85,909 ragiatered for but did not take the TOEFL 
under the International and Special Center teating programs. 
Regiatration raeorda for the Inatitutional TOEFL Teating Program are 
kept by the inatitutiona adminiatering the teat and are noi; available to 
ETS. 

(a) The total amount of faea received from teat taker a during 
1988-89 waa $23,887,522. No record ia available of the amount received 
from California teat takera only. The amount received repreaenta four 
catagoriea of income aa followat 

1. Registration fees paid by individual teat aubjacta. 

2. Additional tranacripta requeatad by individual teat subjects. 

3. Faea paid by inatitutiona for Inatitutional Administration 
forms under the Inatitutional Taating Programa, teat forma are 
diatributed directly to the inatitutiona. Individual taat aubjacta for 
these programa are not regiatered directly by ETS. 

4. Program publications and servicea ordered by examineea. 



Once during 1988-89 
Twice 

More than twice 



247,693 
121,531 
200,552 
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(f) (1) IxF«n««e diractly attributed to thm tmmt (July 1, 1988 - 
June 30, 1989) 

Program Direction $ 2,382,513 

Teat Adniniatration and Related Servicea-International, 
Special Center, US/Canada and Overaeaa Znatitutional Testing 
Programa 13,382,449 

Service-Additional Requests for Transcripts . . * . 495,271 

Test Oevelopnent/Production 3,052,854 

Publications 2,914,385 

Research 261.472 

Subtotal . . .$22,488,944 

(2) Sxpenses indirectly attributed to the test (July 1, 1987 - 
June 30, 1988). 

Policy Council and related activities 175,438 

General Research Planning 6 Coordination. ..... 108,182 

Oevelopaent Studies 249.282 

Subtotal . . . $532,902 
Tocal Expenses for TOEFL $23,021,846 

(g) lach TOSFL applicant registering for the International or 
Special Center program receives a copy of the TOBPL Bulletin of 
Information . Applicants for the Institutional Testing Program receive a 
copy of gxamlnee Handbook and Admiaaion Form. 

Test score recipients include the examinees and universities, 
colleges or other agencies. The examinees receive copies of their score 
and a TOEFL Reouet Form for additional Official Score Reports. The 
colleges, universities and other agencies receive copies of examinees' 
score reports as designated by the examinee and each test score user 
receives a copy of the TQEFL Teat and Sco re Manual . Copies of above 
publications are enclosed. 

(h) National average and atate average test scores are not 
available for the TOEFL test, however, information on the standard error 
of measurement and other statistical characteristics of the test may be 

found on pages 22-31 in the TOEFL Teat and Score Manual. 

(i) Not applicable. TOEFL is not used to predict academic 
performance. 
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(j) Statlstloal data by athnlo background la not avallabla. 
Tablas 7 and 8 on paga 23 of tha Taat and aeora Manual provido moans and 
standard daviatlons of tost sooros by sox. Tablas 9 and 10, pagos 24 
and 25 provldo aoan scoro data by national and linguistic background. 

<k) TOIFL doas not of far admissions data aasanbly sorvlca. 

(1) Nona of tha statistical data Is Individually idant If labia. 



99154. (a) Within 90 days of th« olosa of oach tasting ywar, tha 
tast sponsor shall fila with tha Coonission standard tachnioal data 
aufficiant to dascriba tha psyehoaatric quality of tha tast. 

For purposas of coiBplianca with this aaotion, it is sufficiant to 
daposit with tha Coonission information conforming to tha guidalinaa 
apacifiad in tha Standards for Educational and Psychological Tasts of 
tha Aaarioan Psychological Association, which wara in affaet 180 days 
prior to tha tasting yaar, and which ara appropriata to tha particular 
taat and its usas. 

(b) Data, raports or othar doeumants submittad pursuant to this 
chaptar shall ba aceoopaniad by a dascription of tha tast, including, 
but not limitad to, tha titla, purposa or purposas of tha tast, and whan 
and whara tha tast was administarad in tha stata. 

(c) Data, raports or othar dooinants «ubmittad pursuant to this 
chaptar shall not contain information in a form idantifiabla with 
individuals or particular postsacondary aducational institutions. 



99154. (a) Tachnical data dasciribing tha psychomatric quality of 
tha TOIFL tasts ara includad in tha anclosad tobw. tmrnt. and Seora 
Manual * pp. 20-31. 

(b) A dascription of tha tast appaars in tha romrh Tast and seora 
Manual , pp. 7-8. A dascription of tha tast and its purposa is also 
providad aaeh applicant in tha 1988-89 Bullatln of Information on paga 
3, and sampla quastioni ara providad on pagas 17 through 20; for tha 
Institutional Tasting Program this information ia in tha Bxaminaa 
Handbook on paga 3, with aampla quaationa on pagaa 10-15. 

Lista of tha location and dataa of all TOIFL taat adminiatrationa 
within tha atata of California during taat yaar 1988-89 ara attachad. 
Tha liata for tha Xntamational and Spacial Cantar taat programa ara 
markad "Appandix A." Tha taat aitaa and taat dataa for tha 

Inatitutional taating program ara markad "Appandix B.** 

(c) Nona of thia data ia individually idr' ifiabla— aithar by 
axaminaa or hy Institution, axeapt for tha taat cantar locations. 
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991S6. A tmnt agency shall prapare a claar# aasily undarstandabla 
wtLttmn dascriptlon of aach atandardisad taat it adminiatara* A copy of 
tha appropriata daacriptioa ahall ba providad to tha taat aubjact or tha 
taat acora racipiant togathar with tha taat ragiatration forma and 
ralatad docuaanta, prior to tha adainiatration of tha taat or coinciding 
with tha initial reporting of a taat aoora« Thr daacription ahall 
includa all of tha following informations 

(a) Tha purpoaaa for which tha taat ia oonatructad and intandad to 
ba uaad# 

(b) For thoaa taata uaad to pradict parformanca, tha aubjact 
mattar included on thaaa taata and tha knowladga and akilla which tha 
taat purport a to naaaura* 

(c) Statement a deaigned to provide information for interpreting 
the teat aeorea, including the explanationa of the teat# the atandard 
error of meaauramant# and the correlation between teat acore and 
performance* 

(d) Statement a concerning the effect a and uaea of taat acorea, 
including the following s 

(1) Zf the teat acore ia uaad by itaelf or with other 
information to predict future grade point average, a aummary of exiating 
data on the extent to which the uae of thia teat acore will improve the 
accuracy of predicting future grade point ^average, over and above all 
other information uaad* 

(2) a aummary of existing data on the extent to which the 
improvement in teat acoraa reaulta from teat preparation courses « 

(e) A description of the form in which test scores will be 
reported r and whether the raw teat acoraa will be altered in any way 
before being reported to the teat aubjact « 

(f) A complete deacription of any promiaea or covenants which tho 
test agency makea to the teat aubjact with regard to any of the 
following mattera: 

<1) The accuracy of scoring* 

(2) The time period within which the teat aubjact 's score 
will be reported to the test subject and to the taat acora recipients « 

(3) The privacy of information relating to the test subject, 
including his or her test scores « 

(g) The property intaraat in the test score held by tho test 
subject, if any« 
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(h) Th« p«rlod of tliM th« t«st agancy will ratain th« tast scor*, 
and th« t«st agancy'a pollciss ragardlng th« atorag*, dlapoaal, and 
futura uaa of taat acoraa. 

(i) A daacription of all apaeial aarvicaa vhich will ba providad 
at tha location of tha taat adminiatration to accoonodata handicappad or 
diaablad taat aubjacta. 

(j) Tha policiaa and proeaduraa of tha taat agancy whan thara ia a 
dalay in raporting tha taat acoraa purauant to Saction 91160. 

(k) K rapreaantativa aat of aaatpla taat itama. 

(1) Tha faaa to ba chargad by tha taat aponaor for varioua 
aanricaa mada availabla to tha taat aubjact. 

(a) lach taat agancy ahall cooqply with tha raquirananta of thia 
aaction baginning with tha atart of ita taating yaar which bagina aftar 
January 1, 1985. 



99156. (a) Por Zntamational or Spacial Cantar TOIPL taat takara 
tha raquirad information appaara on paga 3 of tha 1988-89 Bullatin of 
infor—tion undar tha haading "Oanaral ZnforMtion, " and on paga 3 of 
tha Znatitutional Taating Program' a axaitilnaa Handbook and Adminiatration 
Porm . 

Por uniiraraitiaa, collagaa, and othar inatitutiona daaignatad aa 
T08PL acora racipianta tha raquirad information appaara on pp. 7-8 of 
tha TOMFL Taat and Seora Manual. 

(b) Not applicabla. TOBPL doaa not pradict parformanca. 

(c) Raquirad information appaara on paga 11 of ^ho TOgPL Taat and 
Scora Manual undar tha haading "TOIPL Sooraa,** and on pp. 12-13 of tha 
gataminaa Handbook undar tha haading "Taat Raaulta." 

(d) (1) Raquirad information appaara on pp. 14-18 of tha TOEFL 
Taat and Seora Manual undar haading "Uaing TOBPL Scoraa," howavar, TOEFL 
ia not uaad to pradict grada point avaraga. 

(2) Raquirad information appaara on paga 16 in tha Bui latin 
Of Infonaition^ undar tha haading "Praparing for and Taking tha Taat" 
for thoaa applicanta ragiataring for tha Zntarnational/Spacial Cantar 
Taating Program and on paga 7 of tha Ixaminaa Handbook for tha 
Znatitutional Taating Program taat takara. 

(a) Raquirad information on acoring proeaduraa appaara on paga 12- 
13 ia tha Intarnational Taating Program Bullatin of information and on 
pp. 16-18 of tha Znatitutional Taating Program Examinaa Handbook . 
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(f ) (1) XnfonMtion on QuAllty Controls «pp«a«« on p«g« 38 of th« 
Bulltln a t infomMtion and on pftQ* ^9 Of tho Institutional Tasting 

(2) Itequirad iaforaatioo rsgartfiag tha tioM period for 
raporting acoras is found on pag« 13 of tlio ■uiiatin of information and 
Anpileafcion fori , on pago 16 of tha .liiatitutionaX progran's fttniin— 
■andbook and undar tho aaotion of thm Institutional T«stin% Program 
brochura titlad "ttwaaary of Inatitutiosuil Tasting Progran Polioioa." 

(3) Xaquirsd information apposra on paga 11 of tha roEWi. Tmat 
and geor* mmwumi undar tha haading "Confidant iulity of Inf onoation, " in 
tha Handbook for ««Miin<i«a undar tha hMding "Tast Raaulta,** and in tha 
Inatitutional Tasting Program brochurtt undar thm hoading "ITS Policy 
about Ralaaaa of Individual Soora Information. " 

(g) Rutquirad information appmars in tha Bull^fein of informafcion on 
paga 13, undar tha haading "Scrora Raporting Sarvicas," and in tha 
Ixaminaa Handboolf on pago 16. 

(h) Raguirad information appaars in tha BwlltUn Of lOilttCTMtiQn on 
paga 13 undar haading "Tast Seora Oata," and in tha Bxaainoa Handbook on 
paga 23. 

(i) Raquirad information appaars in th« Bullatin of information on 
pagas IS and 16. 

(j) Raguirad information filad undar Paragraph 91160. 

(k) Raprasantativa sampla itaas appaar in tha Bullatin of 
Information, pp. 17-21, undar tha haading "Practica Quastiona," and in 
tha Rxaminaa Handbook, pp. 10-15. 

In addition, during 1988-69 TOSFL axaminaas and othars had accass 
to othar tast forms and ralatad natarials via tha following program 
sarvicas t 

a. TOm sampla Tast (squal to ona-half tha langth of a TOIPL 
tast form). Availabla to anyona at $3 par copy. 

b. Tast aatarials from aalaotad administrations. Thaaa ineluda a 
copy of tha tast book and tha (^astatta, tha eorract anawars to tha 
quastions and a copy of tha axaminaa's anawar shaat with tha raw scoras 
markad. (Availabla to TdPL axaminaas only who took tha Saptambar, and 
Octobar 1988 and Fabruary, March, and May 1989 administratio^.s . ) 

o. Undaratandina TOKfL. A eomplata tast form with cassatta for 
Saction 1, an anawar shaat, and a workbook providing an axplanation for 
aach quastion and sat of answara. Availabla to applicants for $11 with 
tha tast fa« or $13 on a saparata ordar. 
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d. L^a^'anlna to TOKFL . "LLmlimiiLtut to TOIFL fOGUMS On Mctlon 1, 

tha listaning oe«pr«hmision Motion of tho t««t. It containfl a workbook 
and thraa eaa««tta mordlinga. Tho kit also containa two ooaplata TOBFL 
taata, ana«#ar ahaata and liata of tha corraot anaiiara for all of tha 
quaationa. Availabla to applioanta for $11 with tha taat faa or $13 on 
a aaparata ordar. 

•. itoMditio tar roMTL . K atudy kit that foouaaa on Motion 3, 
Vocabulary and Kaading Coarprahanaion. Thara ara 120 praotiea quaationa 
froa raading Paaaa^aa and 120 Toeabulary quaationa frea actual TOBfX 
taata. In addition, thia taat kit containa two full-langth TOITL taat a 
and a eaaaatta raeerdinq which containa tha atiaalua aatarial for tha 
liataninq ooaprahanaion aactiona of tha two TOITL taata. Tha coat a ia 
$11 if ordarad with taat faa or $13 on a aaparata ordar. 
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99157. This ■•etlon do«s not apply to t'>s Taot of Sngllsh &■ « 
Porsign Languaga. 



79158 . If tha taat aganoy will ba dalayad in raportlng a taat 
aubjaet'a aoora for a tioM pariod anounting to 10 ealandar day a bayond 
tha pariod apaeifiad in paragraph (2) of aubdlTiaion (f) of Saction 
99156, tha taat agancy ahall notify tha taat aubjaot lonadiataly. Tha 
notioa ahall indicata tha raaaona for dalay, including, but not limitad 
to, iacorraot, incoa^plata, or inconaiatant paraonal idantifying 
inforaation fumiahad by a taat iiubjlaet. 



99158. Tha Bullatin at infarmation . pago 12, stataa that "taat 
raaulta will ba a«nt ... on« a»ntb aftar you taka tha taat. Undar no 
eireuMitaneaa can *ihmf ba aant any aarliar. In addition a chart on tha 
back covar liata tha taat data, ragiatration oloaing dataa and nailing 
dataa for tha aoora raperta. (Taat raaulta will ba aant out two or 
thraa waaka latar for axaainaaa whoaa umawar ahaata arriva lata at tha 
TOIPL offica or whoaa anawar ahaata ara not cooplatad proparly.) 
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99159. Tha tast mq^ney thAll •■tabllth a formal panal oonpoaad of 
tast aganoy officials to raviaw and dacida caaas of tuapactad tast 
aoora* • • • 



Tast talcarsr thair parants or guardians and othara who advisa tham 
ara antitlad to know why cartain seoraa hava baan quastionad and tha 
proeaduras usad by Iduoatlonal Tasting Sarvica to varify or Invalidata 
auch scoras. 

ITS Taat Saeurity offioo providas for a formal panal composad of 
tast aganoy officials and aanior aaaauraownt ataff who raviaw aitd dacida 
caaaa of suapaotad tast acora inauthanticity or irragularitias . 
•roehuraa axplaining tha ITS tast saeurity proeaduras ara aant to 
axaainaas whosa sooraa ara quastionad (sampla brochura titlad 
"Proeaduras for Quaationad Seoraa" is ineludad with this raport). 
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99160. (a) Nhm«v«r a tMt tgancy is pr«0«nt«d with information 
ifhich randars tha taat aubjact'a taat acora auapactr whathar that infor-- 
Mtion ia in tha fora of allagationa eolluaion or chaating^ or irragular 
taat adflULniatrationr or irragular atatiatical data^ or any othar form. 
Tha taat agancy ahall auhadt tha inforaation to tha raviaw panal. Tha 
panal ahall ba raaponaibla for raviawing tha inforaation and datarmining 
if an invaatigation ia warrantad* 

(a) Inforaation for axaainaaa about tha policy 
of cancalling TOm taat acoraa ia 
proridad on pagaa 9^ 13, and 14 of tha 
1988-89 Bttllatin of TnfQnMtion. If tha 
taat acora ia raf arrad to tha IT8 Taat 
Saeurity of fica for iralidation and raviaw 
by tha foraal panal, a lattar and Taat 
Saeurity of fica broehura ia aant to tha 
axaaiaaa via ragiatarad aail. Ivary 
opportunity ia providad to tha axaminaa to 
prapara a rabuttal. 

(b) Tha taat aubjact shall hava 30 daya following racaipt of tha 
notica by ragiatarad aail to raapond to tha notica of inauthanticity. 

(b) ITS allowa a ainiaua of 30 daya for a taat 
aubjact to raapond following racaipt of a 
ragiatarad aail notica of inauthanticity. 

(c) Zf tha taat aubjact raapenda to tha notica of inauthanticity 
or irragularity of taat acoraa aant by tha taat agancy within tha tima 
pariod apacifiad by aubdiviaion (b), tha taat agancy ahall raviaw tha 
contanta of tha raaponaa and coaply 

(c) Tha procaduraa for aach of thaaa raquira- 
aant a ara daacribad on p. 13 of tha 

Bulltin of Information and in tha BT8 
paaphlat, Procaduraa fer Quaatlonad 

(d) Tha taat agancy ahal.\ ttct ralaaaa confidantial .L%^c -.vx*^ ^on to 
any authorixad taat acora racipianta ragarding a taat aubjact undar 
panding invaatigationt unlaaa authorixad to do ao by tha taat aubjact. 

(d) Raviawa of quaationabla acoraa by ITS ara 
confidantial; ST8 doaa not ralaaaa infer*- 
aation about a quaationad acora to anyona 
unlaaa authorixad to do aa >iy tha taat 
aubjact. 
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(e) Th« tMs uqmncY shall iiaawdiat«Xy xmlmm thm tait icora to 
t««t aubjaot and thm taat acora raoiplants whara no aubatantial 
danea axiata to randar tha inauthantielty or irragularity of tha taat 



va« 



(a) TOirL aeoraa hald during tha invaatigation 
ara ralaaaad Inaadiataly upon a datar- 
aination that no aubatantial avidanea 
axiata to randar tha taat leora 

inauthantic or irragular. 
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eitabath u. Barangtr 
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Anthony C Barnard 
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Unlvanlty of Colorado. BoiUdar 

Suxanoa RiW-WMlama 
VMittam MNnoM UoivtrMty 

Mark a SchufMCk 
Brown UmviraHy 

Judith P. Bwaiay 
Tha Acadia inatmiM 

GUxabath C. T^aupott 
Stftnford Univaftity 

gdward H. wtiaon 
Washington Univtraity 

QanaL. Woodruff 
Univarwty of waihington 
a 

Chtnotta V. Kuh 
Sm^Bty to th9 dottrd 



November 14, 1989 



Mr. Kenneth B. O'Brien 
1020 Twelfth Street 
California Postsecondary 

EdxAcatlon Conlssion 
Sacraaento, CA 95814 

Dear Mr. O'Brien: 

Forwarded herewith pursuant to the revised Gallfomila Education 
Code, Senate Bill No. 1758 » Chapter 1505, Part 65 Chapter 3, Sections 
99152-9959 is information concemlng administrations of the Graduate 
Record Examinations dtiring the 1988-89 testing year which ended on 
September 30, 1989. 

Enclosed ard the following 1988*89 publications and reports 
referred to in this report: 

• GRE Information Bulletin 1988-89 

Guide to the Use of the Graduate Record 
Examinstions Program 1988-89 
^ Interpreting Your GRE General Test Scores 1988-89 
GRE General Test, Edition GR87-10 (3 copies) 
GRE General Test, Edition GR87-11 (3 copies) 
GRE General Test, Edition GR87-12 (3 copies) 
GRE Technical Manxial 

• General Test, Test Analysis Forms 3HGR1, 3IGR4, 3JGR2 
^ GRE/MGSLS Publications List and Order Form 

• Order Form for the 1988-89 Information Bulletin 

• Effects of Coaching on GRE Aptitude Test Scores, 
GREB Report 81-3R 

• Effects of Test Preparation on the Validity of 
GRE Analytical Scores, GREB Report 82-6aF 

• Test Preparation for the GRE Analytical Ability 
Measure: Differential Effects for Subgroups of 
GRE Test Takers. GREB Report 82-6bP 
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Mr. Kenneth B. O'Brien 



November 14, 1989 



* Descriptive booklets for all Subject Tests 

* Tables from Validity of the GRE: 1988-89 Summary Report 

* Procedures for Questioned Scores 

* Tables from Examinee and Score Trends for the GRE General Test: 
1977-78, 1986-87. and 1987-88. 

* Report of Students who have repeated the General Test and Subject 
Tests once^ twice, or more than twice 



The Graduate Record Examinations Board has delegated to Educational Testing 
Service. Princeton, NJ 08541. the specific duty of publication and distribution of 
copies of these materials. 



MBS/jak 
Enclosures 

cc: Mr. Robert A. Altman. Educational Testing Service 
Ms. Charlotte V. Kuh. Educational Testing Service 
Mr. Stanford von Mayrhai^uier . Educational Testing Service 



Sincerely. 




Jasper D. Memory 
Chairman. GRE Board 
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Graduate Record Exanlnaclons Program 
October 1, 1988 • September 30, 1989 



Report prepared for the California 
Postsecondary Education Commission 



November 1989 
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GRADUATE RECORD EXAMINATIONS 



October I, 1988 « September 30, 1989 

Report prepared for 
California Fostsecondary Education Conunlsslon 
In conpllance with 
Fart 65 of the Education Code, Chapter 3, Section 99153 



99153. On or before November 15 of each year, the test sponsor shall sxibmit to 
the Commission all of the following data and Information: 

(a) Three copies of each version of the test which was disclosed In the 
prior testing year, along with the corresponding acceptable answers, and the 
methods used to convert raw scores Into the test scores reported to test subjects 
and test score recipients, together with an explanation of that method. 

(a) Attached to this report are three versions of the 6RE General Test which 
were used in the most recent testing year^ an answer key for each and 
explanation of the scoring of these tests. Also attached are copies of 
the test analysis reports for these test forms. 



99153. (b) The dates of major or national administration of each test 
administered by the test agency during the testing year. 

(b) Dates of the major administrations for the Gradtiate Record 
Examinations are included in the caletidar on the back cover of the 
enclosed GRE 1988-89 Information Bulletin and the Guide to 

the Use of the Graduate Record Examinations Program 1988 > 

59. ^ 



99153. (c) The total number of test subjects who have taken the test once, who 
have taken it twice, and who have taken it more than twice during the testing 
year. 

(c) The number of examinees who have taken the GRE tests once, 
twice, or more than twice is attached as a separate report. 
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99153. (d) The total number of test subjects who registered for, but did not 
take, the test. 

(d) The total nuaber of registrants for aajor ORE administrations 
of all General and Subject Tests in 1988-89 was 421,848. Of 
these registrants, 55,771 did not take the tests. 

In California, there were 35,782 registrants for all GRE 

General and Subject Tests. Of these, 5,917 did not take the tests. 



99153. (e) The total amounts of fees received from test subjects by the test 
agency for the test for that testing year. 

(e) Total fees received from test subjects (test takers) for the 

Graduate Record Examinations for 1988-89 equalled $21,745,495. 
No record is available of the amount received from California 
test takers only; nor are records available for receipts by 
test title. The amount received represents four categories of 
income, as follows: 



1. Registration fees paid by individual test subjects. 

2. Additional transcripts requested by individual test subjects. 

3. Fees paid by institutions for institutional services. 

4. Program publications and services ordered by examinees. 



99153. (f) The expenses to the test sponsor of the test, as follows: (1) the 
expenses which are directly attributable to the test and (2) those expenses which 
are indirectly attributable to the test. 



(f) (1.) Expenses directly attributable to the teat and 

(2.) Expenses indirectly attributable to the test required by 
this section are as follows: 



Income 



Fees from Test Takers for GRE Tests $19,313,963 

Fees for Priced Publications 1,700,415 

Fees for Institutional Services 731.117 

Total $21,745,495 

General Subject 



Expenses Directly Attributable $16,968,479 $7,135,845 



Test Administration $10,034,119 $3,344,706 

Program Direction 1,846,304 615,435 

Test Develofment 2,579,662 2,339,573 

Research 675,999 225,333 

Publications 1,832,395 610,798 

Expenses Indirectly Attributable $529,151 $176,384 



Special Services 395,424 131,808 

GRE Board and Committees 133,151 44,576 

Expenses Mot Attributable $906,329 

Graduate Program Self -Assessment 52,414 
CGS/GRE Survey 84,124 
Directory of Graduate Programs 181,185 
Minority Graduate Student Locator Service 147,799 
GRE/GGS Foruma 132,643 
Technical Manual 69,321 
Outcomes Assessment 238,843 



99153. (g) A copy of all documents, pamphlets, and literature provided to the 
test subject and the test score recipient. 

(g) (1.) Attached to this report are copies of lach doctiment, 
pamphlet, and literature provided to each test taker. 
These are: 

GRE Informatio n Bulletin 1988-89 

Interpreting Your GRE Gene ral Teat Scores 1988-8 9 

A sample Report of Scores (found on pages 52 and 53 of 
the Qai^ to the Pse of the G raduate Record 

EXftWinMifrr^ Program^ 
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(g) (2 0 A copy of Mch document » purphlat» and llttratura 

provided to each teat acore recipient are attached to 
thla repozt* Theae are: 

Guide to the Uae of the Graduate Record 
Examlnatlona Program - 1988^89 

GRE 1988-89 Information Bulletin 

GRE/NGSLS Publlcatlona List and Order Form - 
1988*89 

Order Form for the 1988-89 Information Bulletin 
Gradate Record Examinations and Minority Graduate 
Student Locater Service 

Samples of score reporting forms located on pages 
51-53 of the jSllidfi 



99153. (h) Whore applicable, the national average test scores, state average 
test scores, the standard error of measurement, and any other existing Information 
relevant to a comparison of the test scores of thj state's test subjects with test 
scores of previous test subjects of the past five years. 

(h) GRE average acorea are for the test- taking population reported 
on page 15 of the Guide to the Use of the Creduate Record 
Eraj ain^tjon e Program 1988*89 > The atandard error of 
neaaurement for Individual acorea and score differences are 
reported on page 33 « The reaulta of all aJmlnlstratlons 
of all forma or editions of a given test are reported on the 

same 

scale. National and state average test scores are neither 
gathered nor reported « 



99153. (1) For those tests used to predict academic performance, the most recent 
national or regional aggregation of data conceiving the predictive validity of all 
of the following: 

(1) Academic record or grades alone. 

(2) Standardized test score alone. 

(3) Academic record and test score combined, 

(4) Standardized test scores over and above the 
predictive validity of academic record alone. 

(1) (1-4) Validity of the GRE: 1988-89 Summary Report (In press) 
table copies attached. 
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99153. (J) Using available data> the racial > ethnic » and sex breakdown of all 
test subjects taking each test during the testing year. 



vj) Racial » ethnic and sex information la self -reported by test takers 
and Is not alvays provided to the GRE ProgrMi. 
Available ethnic data for GRE test takers are reported In the 
Guide to the Use of the Graduate Record Examinations Program 
1989-89 > Tables 5 and 6A, pages 25^-26. Racial » ethnic and sex 
info^natlon is reported in various tables throughout Examinee and 
Score Trends for the GRE General^Tests : 1977-78. 1982-83. 1986-87. 
and 1987-88 (in preas^ table copies attached. 



99153. (k) If a separate fee Is charged test subjects for admissions data 
assembly service, the test sponsor shall report Information concerning the data 
assembly service In substantially the same form as would be required for a test 
under this section. 

(k) Not Applicable. 



99153. (1) This section shall not be construed to require any test agency to 
submit to the commission any reports or documents containing Information relating 
to any Individual teat subject. Any Information relating to any Individual test 
subject. Any Information relating to any Individual test shall be deleted or 
obliterated from any reports or documents filed with the commission pursuant to 
this section. 



<1) Information submitted In compliance with this section does not 
Include Information Identifiable with any Individual or 
Institution. 



GRADUATE RECORD EXAMINATIONS 

October 1, 1988 - September 30, 1989 

Report prepared for 
California Postsecondary Education Conmisslon 
In compliance with 
Part 65 of the Education Code, Chapter 3, Section 99154 



99154. (a) Within 90 days of the close of each testing year, the test sponsor 
shall file with the Commission standard technical data sufficient to describe the 
psychometric quality of the test. 

For purposes of compliance with this section, it is sufficient to 
deposit with the Commission information conforming to the guidelines specified in 
the Standards for Educational and Psychological Tests of the American 
Psychological Association, which were In effect 180 days prior to the testing 
year, and which are appropriate to the particular test and its uses. 

<a) Technical data describing the psychometric quality of the 

tests are Incltided In the Guide to the Use off the GRE Program 
and the GRE Technical Manual. 



99154. (b) Data, reports or other documents submitted pursuant to this chapter 
shall be accompanied by a description of the test, including, but not limited to, 
the title, purpose or purposes of the test, and when and where the test was 
administered In the state. 

(b) A 'description of the purposes of the testes and when and where 
they are administered In California is included in the 
GRE Information Bulletin. 



99154. (c) Data, reports or other documents submitted pursuant to this chapter 
shall not contain information in a form identifiable with individuals or 
particular postsecondary educational institutions. 

(c) Information submitted with this section does not Include 
data identifiable with any individual or Institution. 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1988 - September 30 » 1989 

Report prepared for 
California Postsecondary Education Commission 
in compliance with 
Part 65 of the Education Code, Chapter 3, Section 99156 



99156, A test agency shall prepare a clear, easily understandable written 
description of each standardized test it administers. A copy of the appropriate 
description shall be provided to the test subject or the test score recipient 
together with the test registration forms and related documents, prior to the 
administration of the test or coinciding with the initial reporting of a test 
score. The description shall include all of the following information: 



to be used. 



(a) The purposes for which the test Is constructed and intended 



(a) The purposes for which the test are constructed 
are described on page 4 of the GRE Information 
Bulletin . 



99156, (b) For those tests used to predict performance, the subject matter 
included on these tests and the knowledge and skills which the test purports to 
measure . 

<b) The subject matter of and knowledge and skills 

measured by the GRE General Test and GRE Subject Tests is 
described on page 4 of the GRE Information Bulletin . 



99156. (c) Statements designed to provide information for interpreting the test 
scores, including the explanations of the test, the standard error of measurement, 
and the correlation between test score and performance, 

(c) For Information to assist in interpreting test scores, see the 
GBE Information Bulletin, page 23, student score leaflet. 
Interpreting Tour CM General Tea t Scores 1988-89 ; the Guide , 
pp. 11-28; the GRE Subject Test Description Booklets, page 5; 
the GRZ Techni cal Manual . 
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99156 « (d) Statements concerning the effects and uses of test scores, including 
the following: 



(1) If the te^t score Is used by Itself or with other Information to 
predict future grade point average » a summary of existing data on the extent to 
which the use of this test score will Improve the accuracy of predicting future 
grade point average > over and above all other information used* 

(d) (1) The 1981*82 {rMirnn^TT P^poft of the Graduate Record 

ElMlnt^^ffr* Validity Study Service is attached to this 
report « 

(2) A summary of existing data on the extent to which the Improvement in 
test scores results from test preparation courses, 

(2) See the attached research reports: (1) 6REB Report 81- 
3R, Effects of Coachli:g on GRE Aotitude Test S£2Cft&; (2) 
GREB Rtport 82*6aP, Effects of Test Preparation on the 
Validity of the GRE Analytical Scores : (3) GREB Report 82- 

6bF, 

Test Preparation of the GRE Analytical Ability Measure: 
Differential Effects for Subgroups of Test Takers. 



99156* (e) A description of the form in which test scores will be reported, and 
whether the raw test scores will be altered in any way before being reported to 
the test subject. 



(e) Per the form in which test scores will be reported see the GRE 
Information Bulletin, p. 20-22. 



99156 « (f) A complete description of any promises or covenants which the test 
agency makes to the nest subject with regard to any of the following matters: 

(1) The accuracy of scoring. 

(1) Por a description of the accuracy of scoring, see GRE 
Information Bulletin > p. 18. 

(2) The time period within which the te^^t subject's 

score will be reported to the test subject and to 
the test secure recipients, 

(2) Por the time period within which scores will be 
reported, see GRE Information Bulletin, p. 20. 
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(3) The privacy of Information relating to the test subject , 
Including his or her test scores. 



(3) For Information about the privacy of Information, 
see 6RE Information Bulletin, p. 21. 



99156. (g) The property interest in the test score held by the test subject, if 
any. 

(g) For information about property Interest » see 6RE 
Information Bulletin, p. 21. 



99156. (h) The period of time the test agency will retain the teso score, and 
the test agency s policies regarding the storage, disposal, and future use of test 
scores , 

(h) For the retention of scores and use of scores » see 6RE 
Information Bulletin , p, 20-22. 



99156. (1) A description of all special services which will be provided at the 
location of the test administration to accommodate handicapped or disabled test 
sub J ects. 

(1) For a description of handicapped services, 
see GR£ Information Bulletin , p. 11. 



99156. (J) The policies and procedures of the test agency when there is a delay 
in reporting the test scores pursuant to Section 91160. 

(J) For the policies concerning delay in scores, see GRE 
Information Bull :t in, p. 20. 



99156. (k) A representative set of sample test items. 

(k) For a sample General Test and sample questions, 

see pages 28-72, GRE Information Bulletin . For samples of the 
Subject Tests, see the descriptive booklets for each test. 
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99156. (1) The fees to be charged by the test sponsor for various services made 
available to the test subject* 

(1) For test fees, see 6RE Information Bulletin, pp. 4, 10, and 96. 



99156. (m) Each test agency shall comply with the requirements of this section 
beginning with the start of Its testing year which begins after January 1, 1985. 



ERLC 



GRADUATE RECORD EXAMINATIONS 

October 1, 1988 - September 30, 1989 

Report prepared for 
California Postsecond«^ry Education Commission 
in compliiitnce with 
Part 65 of the Education Code, Chapter 3, Section 99157 & 99158 



99157. This section does not apply to the Graduate Record Exdminatlons Program. 



99158. (a) If the test agency will be delayed In reporting a test subject's 
score for a time period anoimting ot 10 calendar days beyond the period specified 
in paragraph (2) of subdivision (f) of Section 99156, the test agency shall notify 
the test subject imedlataly. The notice shall indicate the reasons for delay, 
including, but not limited to, incorrect, incomplete, or inconsistent personal 
identifying infonaation furnished by a tear, subject. 



<a) The procedure for notifying test subjects and score users of 
any delay in submitting scores is described on page 20 of the 
GRE Information Bulletin. 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1988 ■ September 30, 1989 

Report prepared for 
California Postsecondary Education Commls&lon 
In compliance with 
Part 65 of the Education Code, Chapter 3, Section 99159 



99159. (a) through (d) Whenever a test agency Is presented with InformaCion vrhlch 
renders the test subject's score suspect. . . . 

<a) through (d) Test takers, their parents, and others who advise 
them are entitled to know why certain scores have been 
questioned and the procedures used by Educational Testing 

Service (ETS) to verify or Invalidate such scores. The pamphXat Intended to 

provide information to test takers about why their scores have been 

questioned, Procedures for Questioned Scores, 
is attached. 



1^ 
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GRADUATE RECORD EXAMINATIONS 

October 1, 1988 • September 30, 1989 

Report prepared for 
California Postsecondary Education Commission 
in compliance with 
Fart 65 of the Education Code, Chapter 3, Section 99160 



99160. (a) Whenever the test agency determines that substantial evidence exists 
to support cancellation or invalidation of a test score, the test agency shall 
provide the test subject with a choice of the following options: 

(1) A cancellation of the test scores in question, with full refund of 
all test fees* 

(2) Opporttinity to take the test again privately and without charge. 

(3) Opportunity to seek Judicial review of the matter « 

(a) Information for test takers concerning the 

procedures used in cancelling questioned sccres 

is found on page 21 of the GRfi Inforaaticm Bulletin 

and In the pai&phlet^ Procedures for Questioned Scores. 



(b) The teat subject shall have 30 days following receipt of the notice 
by registered mail to respond to the notice of inauthenticity. 

<b) ETS provides up to six weeks for a subject to respond to a 
notice of score inauthenticity « 
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99160, (c) If the test subject responds to the notice of inauthenticity or 
irregularity of test scores sent by the test agency within the time period 
specified by subdivision (b) , the test agency shall review the contents of the 
response and comply 

(1) through (3) The procedures for each of thei^e requirements are 
described on p. 20 of the 6RE Information Bulle tin and in the 
E7S pamphlet » Procedures for Queatiloned Scores. 



99160. (d) The test agency shall not release confidential information to any 
authorized test score recipients regarding a test subject under pending 
Investigation, unless authorized to do so by the test subject. 

(d) Revlevs of questionable scores by ETS are confidential; £TS 
does not release information about a questioned score to 
anyone unless authorized to do so by the test subject. 



99160. (e) The test agency shall immediately release the test score to the test 
stibject and the test score recipients where no substantial evidence exists to 
render the inauthenticity or irregularity of the test score. 

(e) GRE scores held during investigation are relMsed Immediately 
upon a determination that no substantial evidence exists to 
render the test score Inauthentlc or irregular. 
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GRADUATE RECORD EXAMINATIONS 

October 1, x988 • September 30, 1989 

Report prepared for 
California Fostsecondary Education Commission 
In compliance with 
Part 65 of the Education Code, Chapter 3, Section 99161 



99161. (a) No test agency shall release or disclose any test score Identifiable 
with any individual test subject, in any form whatsoever, to any test score 
recipient, unless the agency is specifically authorized by the test subject to 
release that test score to the recipient, A test agency may, however, release all 
scores received by a test subject on a test to anyone designated by the test 
subject to receive the test score, 

(a) The confidentiality of GRE scores Is described for GRE score 
users on page 9 of the Guide to the Use of the GRE Program, 
Page 21 of the GRE Information Bulletin provide test takers 
with information about confidentiality GRE scores. 
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Novraber l* 1989 



Hr* Uan«th B. 0*Brl«a 
Ez«cut:iv« Dlr«ctor 
California Poat-*S«coadary 

Education Coanlsslon 
1020 12th Stmt 
Sacraaanto, California 95814 



Dear Mr* 0' Brian: 

On bahalf of tha Graduate ManagaMnt Adalaalon Council i tha sponaor of 
tha Graduate Managaaant Adalaalon Teat, I aa pleaaad to aubalt tha 

Inforaatlon raqulrad under Chapter 1503 of tha lava of tha atate of 
California; Chapter 3, Part 65 of the Education Code, Sectlona 
99150-99164. 

Reapec£full7f 



Reapec^fully, ^ 

Wllliaa Broaaaala 
Praaidant 



JOMPII P. Fox 

Chaiiman 

MtmiMttt UnivMity 

JudHh A. Goodman 
ViotCtwinnan 
Univ««ty o( Micfttgan 

ljM» Cunningham 
UrMraity o( Chicaoo 

RogarL Jankina 
Univaraily o( TannaasM 

Kannach R. Kaatay 

ONo SUM Urwtrstty 

Suian McTI«min 

HofsM UnivMity 

PaMa W. MulMtand 
Indiana Univarsicy 

Dan H. Robartaon 
Taxaa A & M Umvarsity 



WHttam Broaaamta 



Roaa M. Stotzanbarg 
Vica Pra si dant Rasaarcn 

Lavyranca W. Hacht 
SacrattfV 



Enclosures : 



1) October 1988» January 1989, March 1989 and Juna 1989 
GMATa and Anaiiar Kaya (3 coplaa aach) 

2) GHAT TECHNICAL REPORT 

3) GMAT 1988-89 BOULBTIN OP INPORMATION 

4) GMAT EXAHINEE SCORE INTERPRETATION GUIDE 

5) GUIDE TO THE USE OP GMAT SCORES 

6) PROCEDURES POR QUESTIONED SCORES 

7) STATISTICAL DATA (COMPUTER PRINT-OUTS) 



/pa 
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i ^^[) Reply to- 

Los Angeles 109 
Princeton 
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Graduate Management Adnisslon Council 



99153 

(a)(b) Endoaad are threa (3) copies each of the actual Graduate 

Manageaent Adalsslon Tests administered on the regular national 
administration dates: 

October IS, 1988 (test code 78) 
January 28, 1989 (test code 80) 
March 18, 1989 (teat code 81) 
June 17., 1989 (test code 82) 

Also Included are scoring keys and explanatory materials. 

(c) During 1988-89, 221, 4SS, Individuals took the 6MAT. The 
numbers of Individuals who took It once, twice and more than 
twice during the year are not available • 

(d) During 1988-89, 59,800 Individuals registered for but did not 
take the GMAT. 

Section 99153 - Financial Information. Definitions are provided on the 
following page. 

(e) Total amount of fees received from test takers: 



1. (SiikT Testing Program 

2. Guides to GMAT/MBA 

3. MBA Admission Fonas 
Total Income from test takers 



$9,712,600 
1,357,600 
46,700 
$11,116,900 



(f)(1) Expenses directly attributable to the testing program: 

4. GMAT Test Administration $8,155,900 

5. GMAT Test Development 1,057,600 

6. GMAT Validity Studies and Test Research 470.200 
Total expenses dlrectl/ attributable to the 

testing program $9,683,700 

(f)(2) Expenses Indirectly attributable to the testing program: 
7. 



Institutional Programs and Council 
Administration 

8. Guides to GMAT/MBA 

9. MBA Admission Forums 

10. Other Publications and Programs for 

Prospective MBA Candidates 
Total expenses Indirectly attributable to 
the testing program 



Total Council Expenses 



$2,242,200 
1,033,700 
304,500 



552,800 



$4,133,200 
$13,816,900 
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D«£laltlons of the financial information raportad by tha Graduate 
Managemant Adnlsaion Council pursuant to Sactlon 99133* 

Lina I Paaa racalvad fro« taat takars for tha tasting prograa include 
faas for tha tast raglstration and basic scora raporting 
sarvica. Additional scora raports aay ba purchasad by 
candidates for an additional fee. Other service fees are for 
late registrations, suppleaentary test centers, foreign teat 
center surcharges, test center changea, teat diadoaure 
■ateriala, and hand reacoring aervicea* 

Unea 2 Revenue and expenae for the GUIDB TO MBA and tha GUIDE TO GHAT 
and 8 are frott aale and production of thaae two publicationa • The 
60IDE TO MBA indudea a aaction about graduate atudy in 
■anageMent, caraera, aud deaeriptiona of aore than 500 
different MBA prograaa. The GUIDE TO GM4T containa aaaple 
queationa froB previously adainiatered Graduate Managenent 
Adalaaion Teata, with correct anawara and explanationa provided 
and a aath review aaction. A aoftware veraion of the GMAT 
Guide waa introduced in fiscal 1986-87. 

Unea 3 Ravenuea froa the MBA Adaiaaion Foruaa are received from 
and 9 studanta who attend theae eventa, which gather repreaentativea 
froa the adalaaiona offieea of over 75 graduate achoola of 
aaaageaent in a aingle location to facilitate the exchange of 
Inforaation with proapective applicanta and to provide an 
opportunity for atudenta to aak questions about the GKAT. 
Bxpenaea are incurred for planning and operating theae 
prograaa. 

Line 4 Expenaea incurred for teat adalnlatration include all expenses 
of teat regiatration, teat center adainiatration, teat related 
publicationa and aallinga including teat diadoaure materials, 
coaputer acoring and reporting, statistical analysis, clerical 
responaea to inqulriea, and quality aaaurance* 

Line 5 Bxpenaea for teat development in 1988''89 include all expenses 
incurred for item writing, preteating, and coapllation of test 
foraa, aa well aa atatiatical analyaia for new test 
developaent. These are not the costs of the coaplete 
development of any one or more test forms, as the lead time to 
develop a test form is often 24 months. The test development 
cost incurred In any single year are for various phases of the 
development of several different forms* 

Line 6 Expenses are incurred for research concerning various aspects 
of the GMAT, development, storage, and reporting of technical 
data and candidate information about the test, and research on 
the validity of the test performed for Individual management 
schools* 
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« 

Ua« 7 Bxp«nt«« Included In this lln« art Incurred for development and 
operation cf adolsalons services for Institutions which are 
broader than those projects Included In #6 above. This Item 
also Includes expenses for the operations of the Graduate 
Management Admission Council which are necessary for It to 
maintain Its active role In graduate management education, and 
responsibility for poller •ntl direction of the testing program. 
It also Includes expenses for education and professional 
development of admissions officers, the primary user of the 
test. 



Line 10 Expenses are Incurred for publications and programs provided 
without charge for prospective MBA candidates. These Include 
publications concerning financial aid and Information for 
International students, and programs to promote awareness of 
graduate management education among members of minority groups. 
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(g) Bncl08«d m copies of the GHAT BULLBTIN OP INPORMATIOM, GMAT 
BXAMINBE SCORE INTERPRETATION GUIDE, end THE GOIDE TO THE USE OP 
GHAT SCORES. 

(h) The Men GMAT seeled score eppeers In Teble 2 of the EXAMINEE SCORE 
INTERPRETATION GOIDE. The scendard error of aeesurement for the 
GNAT toftel score for recent forM Is ebout 2^; this Informetlon 
elso eppeers with en explenetlon In the EXAMINEE GUIDE. 
Informetlon concerning Cellfomle test-tekers Is contelned la the 
enclosed coaputer prlnt-outs. 

The required Inforwtlon epperrs In r.ne publlcetlon GMAT EXAMINEE 
SCORE INTERPRETATION GUIDE, diitrlbuted to ell test subjects with 
their score report. It elso eppeers on page 11 of THE GUIDE TO THE 
USB OP GMAT SCORES, distributed to all Instlcutlonal score 
recipients . 

(J) This d is Included in the enclosed coaputer print-outs. 

(k) This section is not eppllcable. 

(1) None of these dete are individually identifiable. 



"(a) A copy of the GMAT TECHNICAL REPORT (copyright 1986) containing the 
required dete is enclosed. 

(b) A description of the test Including title end purpoee of the test, 
is confrained in the GMAT 1988-89 BULLETIN OP INPORMATION for 
cendld Cee, pege 4. A schedule of locetlons and detes of test 
adainiJtratlons in California eppeers on pege 26 of the BULLETIN. 

(c) None of these data arc individually identifiable. 
991S6 

(a) This inforaatlon is contained in the BULLETIN on pages 4 and 14. 

(b) This inforaatlon eppeers on page 4 of the BULLETIN. 

(c) The EXAMINEE SCORE INTERPRETATION GUIDE contains this information. 

(d)(1) This inforaatlon is contained in the GMAT EXAMINEE SCORE 

INTERPRETATION GUIDE and in THE GUIDE TO THE USE OP GMAT SCORES on 
page 11. 

(2) The Graduate Management Admission Council is not aware of any 

existing data on this subject. This Is stated la the BULLETIN on 
page 12* 

(«) This description appears on page 14 of Che BULLETIN. 
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(f)(1) Thase deacrlptlont appear on pages 14 and 15 of the BULLETIN. 
(2)(3) 

(g) This Is described on page 14 of the BULLETIN. 

(h) This Is described on page 14 of the BULLETIN. 

(1) Special services provided for handicapped or disabled test subjects 
are explained on page 10 of the BULLETIN. 



(j) The policies and procedures In these situations am described on 
page 16 of the BULLETIN. 

(k) A representative set of saaple test Items appear on pages 17, 18, 
19, and 22 of the BULLETINo 

(1) Fees for various services are listed on the back cover of the 
BULLETIN. 

99157 

(a)(b) Test disclosure services are described on page 13 of the BULLETIN. 

(c)(d) 

(•)(f) 

99158 Such a policy Is In effect for the GMAT prograa. 
99159 

(a)(b) The procedures followed are described In BTS PROCEDURES 

(c)(d) FOR QUESTIONED SCORES. 

and 

99160 

(«)(b) 

(c)(d) 

(•)(f) 

(g) 

99161 The QikC policy In this regard Is articulated on page 14 of the 
BULLETIN. 



NWB/ps 

10/31/89 
kag-8-5 
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Law School Admission Services 



Box 40 

Newtown, PA 18940-0040 




Test Development «ind 
Research Division 



215.968.1207 
FAX 215.968.1169 



December 7, 1989 



Dr. Horace F. Crandell 
Postsecondary Education Administrator 
California Postsecondary Education Ccmmission 
1020 Twelfth Street 
Sacramento, CA 95814 



Re: Law School Admission Coondl/Law School Admission Services 
Sponsor of the Law School Admission Test 



Dear Dr. Crandell: 

I submit herewith material reflective of Law School Admission Council/Law School 
Admission Services' compliance with Chapter 3 of Part 65 of the Education Code of 
California (the ''Act'*), as it pertains to the Law School Admission Test, a standardized test 
as described in the Act. These subnaissions comprise Law School Admission Council/Law 
School Admission Services' filing under Section 99153 and 99155 of the Act. 

Information required by Section 99153 is reported below for the program year ending June 
30, 1989, with reference to applicable subsections of the Act. 

Section 99153 (a). Three copies of each version of the test which was disclosed in the prior 
test year, along with the corresponding acceptable answers, and the methods used to coi vert 
raw scores into the test scores reported to test subjects and test score recipients, together 
with an explanation of that method. 

Section 99153 (b). The dates of major or national administration of each test administered 
during the testing year: 

June 13, 1988 
October 1, 1988 
December 3, 1988 
February 11, 1989. 

Section 99153 (c). The total number of test subjects who have taken the test once: 107,288; 
who have taken the test twice: D,999; and who have taken it more than twice: 691 during 
the testing year. 

Section 99153 (d). The total number of test subjects who registered for, but did not take the 
test: 25, 285* 

Section 99153 (g). A copy of all documents, pamphlets, and literature provided to the test 
subjects and the test score recipient. 
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Semces for Lei^al Education from the Law School Adfmston Counctt 



Dr. Horace F. Crandell 
December 7, 1989 
Page Two 



The LSAT/LSDAS Information Book and Sample LSAT are distributed to all test 
candidates* Exhibit '*A^ the 198M9 LSAT/LSDAS Infomadon Book and Sample LSAT, 
contains the required information on the following pages: 

a) the purpose for which the test is constructed and intended to be used - 
Page 9; 

b) the subject matters included on each test and the knowledge and skills that 
the test purports to measure pages 9 and 76 • 92; 

c) the manner in which the test is scored and the relationship of the raw and 
scaled scores to the skills and knawkdgfi it measures pages 9, 21 - 23, 
and 31 • 32; 

d) the basis upon which such scores will be made available to persons or 
institutions *• pages 23-24; 

e) a representative set of sample test items - pages 76 - 128. 

The Act requires that test subjects be provided with explanatory information to facilitate 
p oper interpretation of test scores. Test subjects are provided with information on pages 
31 -32 of Ediibit "A*" that explains the meaning of scores indudfaig: Validity, Reliability, 
Standard Error of Measurement^ and Repeater StatistiGS. Infomudon on these subjects also 
appears on the reverse of the test score report sent to each test subject In fulfiUment of 
other obligations, designated institutions tluit are score redpients have also been provided 
with this information* They additionally will have received the LSAC/LSAS Desk Book 
before the first report of test scores in the current test year. A copy of the 1988^ 
LSAC/LSAS Desk Book is included with this letter as Exhibit *13* in compliance with the 
provision that this information be provided to the Commission *prior to or coincident with 
the first reporting of test scores to any test score recipient during a testing year/ Test dates 
and locations at which the LSAT was administered in California in 1988*89 are indicated at 
page 66 of Exhibit ''A^ The first test during the 1988*89 testing year was given on June 13, 
1988, with scores to be reported to test score recipients approximately four to six weeb 
later. 

Test score recipients are provided with standard technical data sufficient to describe the 
psychometric quality of the test* These are provided in Exhibit *B,* the LSAC/LSAS Desk 
Bcok, a manual for users of the Law School Admission Test. Topics covered include: what 
the test measures (pg. 10), test scoring (pg. 12), test reporting (pg. 12-13), validity (pg* 16- 
17), standard error of measurement and reliability (pg* 17<18), statistical data for the LSAT- 
National (pg. 18*19), and avoiding misuse of the scores (pg« 22). 

Section 99153 (h). Where applicable, the national average test score: 30.0, the state average 
test score: 30^ Information on the standard error of measurement, and any other existing 
information relevant to a comparison of the test scores of the state's test subjects with test 
scores of previous test subjects of the past five years can be found under 99153 (g). 
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Dr. Horace F. CrandeU 
December 7, 1989 
Page Three 



Section 99153 (i). For those tests used to predict academic performance, the most recent 
national or rrgionai aggregation of data concerning the predictive validity of all the 
following: 

1. Academic record or grades alone. 

2. Standardized test score alone. 

3. Academic record and test score combination. 

4. Standardized test scores over and above the predictive validity of academic 
record alone. 

Over the years, the majority of law sch'jols have participated in statistical studies that 
compared students' LSAT scores with Jieir first-year gnules in law school Although the 
correlations between test scores and grades are not pwfect, these studies show that LSAT 
scores help to predict ^ch students will de will in law scliod« Moreover, a combination of 
students' scores and undergraduate grade averages gives a better prediction than either 
factor considered alone. As is the case with undergraduate grade averages, the correlation 
between LSAT scores and first*year law school grades varies from one law school to 
another. During 1988, correlation studies were conducted for 156 of the 186 LSAC-member 
schools (186 includes Canadian members). Correlations between LSAT scores and first-year 
law school grades ranged from .19 - .64. Correlations between LSAT scores combined with 
undergraduate grade averages and first*year law school grades ranged from .28 • .69. 

The published reference set entitled Law School Admission Iksearch includes validity 
information in the study designated LSAC 76-78; WA. Schrader, Summary of Law School 
Validity Studies, 1948*75, VoLIII, p. 519, which was filed with the Commission in September 
1979. Volume IV of Law School Admission Research, which was Skd with the Commission 
in December 1985, includes the most recent data concerning predictive validity in the studies 
designated LSAT^^l, F.R. Evans, Recent Trends in Law School Validity Studies, p. 347, 
and LSAC-83-1, R. L Linn and CJ4. Hastings, A Meta-Analysis of the Validity of Predictors 
of Performance in Law School. These studies have been distributed to institutions that are 
test score recipients as required 

Section 99153 (j)* Using available data, the racial, ethnic, and sex breakdown of all test 
subjects taking the test during the testing year 



Male 68358 

Female 53,470 

No response 150 

American Indian 602 

Black/Afro-American 8,599 

Caucasian/White 94,470 

Chicano/Mexican**Amcrican 1^284 

Hispanic 2,873 

Asian-Amcrican/Padfic Islander 4,839 

Puerto Rican ijsil 

Other 108 

No response 8,142 

Total 121,978 
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Dr. Horace F. Craadell 
December 7, 1989 
Page Four 



To meet the requirements of Section 99153 (e), (f), and (k), I am enclosing a copy of the 
1988-89 Audited Fmandal Report for LSAC/LSAS along with detailed mformation on the 
fee schedule in use during that fiscal year (Ediibit '^C and Ediibit **B^ page 7). As you will 
notei LSAC/LSAS provides comprehensive admission services to law sdiool applicants and 
to law schools; thus, allocaticHis of revenue to discrete services would not provide an 
accurate picture of the relationship of fees to services. We feel thf t the audited financial 
report will afiford you a greater familiarity with the financial posture of LSAC/LSAS than 
would be possible by artificially disaggregatmg financial data and allocating it to specific 
services- 
Information required by Seclion 99155 is reported below for the program year ending 1988- 
89, with reference to applicable sections of the Act 

Section 99155 (a). The total number of test subjects who took the test at a test center 
located m the state of California: 13394 (this number may include mdividuals taking the 
test more than once). 

Section 99155 (b). The performance of California test subjects. Tue state average score: 
302. 

Information relevant to a comparison of the test scores of state's test subjects with test 
scores of previous subjects of the past five years can be found in this letter of compliance 
under 99153 (g). 

Section 99155 (c). The predictive validity of test scores as specified in subdivision (i) of 
Section 19953. Information relevant to ^dity is contained in this letter of compliance 
under 99153 (i). 

Section 19955 A description of the information specified in subdivisions (a), (b), and 
(c) according to the sex aud ethnicity of test subjects. 

(a) Using available data, the racial, ethnic, and sex breakdown of all test 

subjects taking the test during the testing year in the state of California: 



Male 7;a0 

Female 6,159 

American Indian HQ 

Black/Afro-American 881 

Caucasian/White 9,027 

Chicano/Mexican-American 543 

Hispanic 522 
Asian-American/Padfic Islander 1,156 

Puerto Rican 52 

Other 15 

No response 1,088 

Total 13394 




Dn Horace F. Crandcll 
December 7, 1989 
Page Five 



(b). Using available data, the racial* ethnic, and sex breakdown of all test scores 
for subjects taking the test during the testing year in the state of CaUfomia 
(this data may indude more than one score for some individuals* but docs 
not include scores that were cancelled). 



(c). The published reference set entitled Law School Admission Reseoith 

includes information on validity broken down by sex* race* and ethnic group 
in the study designated LSAC 76^; Barbara Pitcher, Subgroups Validity 
Study, Vol in, p. 413, which was ffled with the Commission m January 



Section 99155 (e). The revenues received by test sponsors, and the proportion of those 
revenues expended for test development and admidstration. A copy of the 19S&'S9 Audited 
Financial Report is attached as Exhibit 

This completes the information required by the Act. Please fee* free to contact me if I can 
provide any further information. 



Male 
Female 
No response 



30.5 
30.0 
29.8 



American Indian 

Black/Afro-American 

Caucasian/White 

Chicano/Mexican-American. 

Hispanic 

Asian-American/Padfic Islander 

Puerto Rican 

No response 

Other 

Total 



27.8 
22.4 
310 
26.1 
26.7 
29.7 
252 
27.1 
25.9 
302 



1987. 



Sincerely^ 




Deputy Vice President 
Test Development 
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Enclosures 
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EXHIBITS AND ENCLOSURES 



Exhibit A ~ 1988 - 89 LSAT/LSDAS Information Book and Sample LSAT 

Exhibit B 1988 - 89 LSAC/LSAS Desk Book 

Exhibit C ~ 1988 -89 Audited Financial Report 

Enclosures - 1) Disclosed test (3 copies) and answer keys 

June 13. 1988 
October 1, 1988 
December 3, 1988 
February 11, 1989 

2) 1988 . 89 LSAT/LSDAS Information Book and Sample LSAT 

3) im ' 89 LSAC/LSAS Desk Book 

4) 1988 - 89 Audited Financial Report 
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Pund baUncaa, Juna 30, 19B7| aa pravioualy raportad 

lUtroactlva raatalaMiit and raelaaaification (nota 3) 
Capitalita invaotory coata 
Otfar and aMortlsa taat davalopaant coata 
ilacord InvaatMOta at aarkat 

Adopt fluid accounting 

Pund baUncaai Juna 30» 1987, aa raatatad 

Eicaaa (daflclancy) of ravanuaa ovar axpanaea, aa real 

Intarfund tranafara 

Loan progran financing coata 

Raaaarch axpandituraa 

iaaaarcb fund liiiitation adJuatMnt 

Financial aid fund %uc%%% 

Canaral optrating fund axcaaa 

Dapraciation 

Purchaaa of proparty and aquipMnt 

fund balancaa^ Juna 30, I9B8, at raatatad 

Bxcaaa (daliciancy) of ravanuaa ovar axpana a 

ttatrictad projact tvanafar 

Intarfund tranafara 

Financial aid fund (dtMciancy) 
Ganaral operating fund aitctaa 
Dtpraciation 

Purchaaa of proparty and aquipaant 
Fund baiancaa, Ju.ia 30, 1989 



Saa notea to combined financial atatasenta 



1^1 



UU SCHOOL ADHISSION SISKVlCeS, INC* AND 
LAW SCHOOL AMISSION COUNCIL, INC. 



Combined StattMinta of Changea in Fund Balatca.^ 
For Yaara Ended June 30, 1986 and 1989 



General 
Opereting Fund 


Finenciel 
Aid Fund 


InveetMent 

Fund 


Property end 
EquipMnt 
Fund 


lleeeerch 
Fund 


Hlnority 
Mecruit»enc Fund 


Totel 

All Fundi 


8 13,332,436 


9 


8 


$ 


- 


S 


8 




113 332 436 


161,394 
987,809 

(14.481,839) 


M 
M 


(692,033) 
6.962.214 




3.422.340 


1.396,458 




700.627 


161,594 
987,809 
(692,055) 






6,270,139 




3,422,340 


1.396.436 




700,627 


13 789 784 


3,318,723 


33,314 


1,032,332 




(62,723) 


(3,030) 




(70,113) 


6,488,881 


(135,131) 
(3,030) 
396,438 
33,314 
(3,810,314) 


133,131 
(33,314) 


- 

3,810,314 
1,006,373 
(1.012.092) 




- 

(1,006,373) 
1.012.092 


3,050 




- 
- 


- 
- 


- 


133,131 


13.127,688 




3.363,332 


1,000,000 




630,514 


20,278,665 


3,808,988 


(843,018) 


1,439,771 




(29,963) 






(53,137) 


4,340,641 


(866,681) 










866,681 








(689,887) 
(2,232,420) 


689,887 


2,232,420 
1,137,893 
(2.366.128) 




(1.137,893) 
2.366.128 












$ 


$15.411.646 




6.763.602 


$1.866,681 


? 


57?. 37/ 


$24,619,306 



I 

\ 

SESTeOPY AVAILABLE 



ItvtnuM 

/UittlMloii ttrvlet (••• 
fublletliofi ^rogrM 
Sliidtfil lot» ^rogrM 

Workthopt 

ItoU ottlput tiMl rtporit 
InltrttI iMcoM 

Nat lota on tfU^tal of lon|-*t«ni InvattMnlt 
UnrMlUaa •ppraclttlon (^apraelttion) of 

lon|*iir« UvttKMiilt 
NliCiiiiMOtti i»coM (tsptAtt) 
Toitl rtvtfttttt 

Kxptnttt (noltt 1 9*4 4) 
Pttrtonntl 

trofaaaUnal Mrvicto 

Uw Mhool o^ucitloR progroM 

Htyotcil piiiil 

KqulpMnl. auvpiioe, Mtoriilt Mi Minttnanea 
CoMUAlealioda an4 ahipplng 
Ganaral ^aftnaai* 

Tolgi aipanaaa 

Ixeaaa (^afieianey) of ravanuaa ovar aapanaaa 
Malriciaa projael iranafar 

iMcaaa (rfafletancy) of ravanuaa ovar 
axpanaaa aftar raairiclarf 
projael Iranafar , 



Mtalatvd} aca nolo S 

8aa no(aa lo cosblnf'* financial alattMnta 
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UU SCHOOL ADHISSIOM SKRVICKSi, INC. AND 
, UW SCMOOt AMISSION COUNCIL. INC. 



CoMblnad Slalaoenla of Kavanuaa and liptnaaa 



taar Ended Juna >0. iW 



froparty and 

Ganaral rioancUl InvaatMnt V^ulpaant Maaarck 

Oparatiwi fund Aid fund rund puod fund 



Hlnorlty 
tacruU—ftt Pund 



Total AU funda 



Vaar inda d Juna 

iwi 



ll.02f.HI 

f2.8lf 
•1.21) 



S.lll,200 
2.8S).U2 
241.00) 
541. )I0 
).H).I72 
1.401.204 
I>t24,444 



•)).640 
2ft. 200 



if>434.4M iyi.140 



U2.828 
411.41) 

42.328 
384.404 
114.444 
20f.0 2l 



20f.o ; 



). 808,988 (84)»01B) 
(844>48l ) - 



I.m.l47 
(44),40l) 

)04.20) 



l.45f.7n 



(2»>f4) ) 



)).i)y 



(2f.f4)) 



§44.481 



|l8.02f.44l 
944. )54 
8)). 440 
3)).988 
118.819 
88.28) 
1.799. 141 
(441.401) 

304.20) 

2I.)44J0I 



).)34.024 
3.244.777 
294.140 
410.708 
4.3)0.474 
l.)l).848 
t.^>>>44) 



()3.I37) 4.340.441 



$14,014,814 
974.408 
494.214 
199.72) 
)9.480 
120.2)4 
1.337.40) 
(1)4.381) 

(130.490) 



()7,002 ) 
19,640,4 



.42) 



4.7' JL U4 
l.8^«,S91 
242.0)2 
533.00) 
3.028.544 
1.093.748 
1.024,958 



4.488.881 



1 2.9A2,y01 L(»»)iOI» JJoiiUil $ (29.943 ) t 644.481 



(53,137 ) i 4.340,441 | 4,488,881 




ASSCEIAnONQF 
AMERICAN 
MEDICAL CXmCES 



ONE DUPONr CIRCLE. NW 
WASHINGTON, rc 20036 
TELEPHONE (202)8280400 



March 6, 1990 



Jeane Ludwlg 

California Postsecondary 

Education Commission 
Third Floor 
1020 Twelfth Street 
Sacramento, California 95814 

Dear Ms. Ludwig: 

The information noted below is submitted in response to the requirements of 
Sections 99154, 99155 and 99157 of the California Education Code concerning the 
Medical College Admission Test (MCAT) . 

The summary of income and expenses for the MCAT and AMCAS as required by Sections 
99154 and 99155 is delineated on the atta:r,hed statement* The following data on 
the MCAT is reported for the July 1. 1988 to June 30, 1989 test^.|jf: 

Total number of tests administered 38,149 

Total number of individuals taking 35,187 
the MCAT once during the test year 

Total number of individuals taking 1,481 
the MCAT twice during the test year 

Total number of individuals who 6,628 
registered but did not take the 
test for which they registered 

Since the test is given once in the spring and once in the fall, the maximum 
number of times an individual can sit for the test during a calendar year is two. 
The MCAT fee was $85.00 for the fall 1988 administration and $95.00 for the 
spring 1989 administration. Individuals who register for a specific test 
administration and subsequently do not sit for that test are provided the 
opportunity to register for the following test administration for no additional 
fee . 
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Jeane Ludwig 
Page 2 

March 6, 1990 



The attached document entitled, "Explanation of Scores for Examinees" accompanies 
all score reports to examinees to assist in the interpretation of their score 
performance. This document is accompanied by a table which depicts the aggregate 
performance of fi^ll examinees sitting for the same test. The MCAT Student Manual 
is still available to examinees and has not changed since last year. 

If you have any questions concerning any of the enclosed information, please feel 
free to get in touch with me. 



April 1989 Table 1 

MCAT 1988 Sununary of Score Distributions 

by Areas of Assessment 
MCAT 1989 Registration Packet 
Explanation of Scores for Examinees 



Sincerely, 




Research Associate 

Section for Educational Research 



JK:pc 

Enclosures: September 1988 Table 1 




11;57 AM 
3-02-90 



STATEMENT OF INCOME AND EXPENSES 
MEDICAL COLLEGE ADMISSIONS TEST (MCAT) 
AMERICAN MEDICAL COLLEGE APPLICATION SERVICE (AMCAS: 
FOR THE PERIOD JULY 1. 1988 TO JUNE 30. 1989 



MCAT 



EXPENSES 



Page 



AMCAS 



A. Directly Attributable to the Test 

1) MCAT Research and Development 450.791 

2) Operations 1.578.945 

3) Interpretive Services & Information Dissemination 489.077 

4) Reserve for Future Redesign 

5) Special Legal Services 76.116 

3. Indirectly Attributable to the Test 

1) Overhead 131.448 



699.947 



C. Data Assembly Services 



1) AMCAS Reporting. . , 

2) AMCAS Development 



TOTAL EXPENSES. 



2,726,377 



2.560.210 
32.700 



3,292.857 



INCOME 

.MCAT Testing Fees 

Additional MCAT Score Report Fees 
AMCAS Fees 



TOTAL INCO.ME. 



INCOME OVER EXPENSES 



3,750, 181 
133.792 



4 .492,640 



3.883.973 



1 , 157.596 



4 .492.640 



1 . 199.783 



.MCAT RESEARCH & DEVELOPMENT - Continued development of test items and forms and research 
concerned with test interpretation. 

OPERATIONS •- Activities associated with national te.st administration and score reporting, 

INTERPRETIVE SERVICES & INFORMATION DISSEMINATION - Provision of materials, reports, and 
consulation regarding MCAT interpretation and performance. 

OVERHEAD - 70"^ on salaries of AAMC personnel. Calculated at federally audited rate. 

.AMCAS REPORTING - Omar, i zat Ion . validation, and dissemination of application materials", 
including MCAT scores. 
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PERCENTAGES OF MCAT EXAMINEES ACHIEVING SCALED SCORE LEVELS 
AND ASSOCIATED PERCENTILE RANK RANGES BY AREA OF ASSESSMENT 
SEPTEMBER 1 988 ADMINISTRATION 
N = 20,583 





Biology 


Chemistry 


Physics 


Science Problems 


Skills Analysis: 
Reading 


Skills Aiialysis; 
Quantitative 




Scaled 
Score 


Percent 
Achieving 
Score 


Percentile 
Rank 
Range 


Percent 
Achievino 
Score 


Percentile 
Rank 
Range 


Percent 

1 1 lev II lU 

Score 


Percentile 
Range 


Percent 

A r* K ioii inn 
^UIIIWIi ll| 

Score 


Percentile 
nanK 
Range 


Percent 
ncnieviny 
Score 


Percentile 
nanK 
Range 


Percent 
Mcnieving 
Score 


Percentile 
Rank 
Range 


Scaled 
Score 


15 


0.0 


99.9 


0.0 


99.9 


0.6 


99.5-99.9 


0.3 


99.8-99.9 


— 




0.1 


99.9 


1 0 


14 


0.0 


99.9 


0.6 


99.5-99.9 


1.5 


99-99.4 


0.9 


98.9-99.7 


— 




0.5 


99.5-99.9 


1 A 
1 «# 


13 


1.8 


98.2-99.9 


2.2 


97.3-99.4 


2.3 


95.8-98 


1.8 


98-98.8 


0.2 


99.9 


1.1 


98.4-99.4 


1 J 


12 


6.0 


93-98.1 


4.2 


94-97.2 


3.3 


93-95.7 


4.0 


94-97 


1.7 


98.2-99.8 


2.7 


95.6-98.3 


12 


1 1 


94 


84-92 


7.9 


86-93 


6.6 


87-92 


6.4 


88-93 


5.8 


92.4-98.1 


6.8 


88.8-95.5 


1 1 


10 


13.1 


71-83 


10.5 


76-86 


9.0 


78-86 


10.6 


77-87 


14.0 


79-92.3 


7.6 


82-88.7 


10 


9 


15.2 


55-70 


10.9 


66-76 


11.4 


66-77 


12.6 


64-76 


16.9 


62-78 


12.9 


69-81 


9 


8 


15.2 


40-54 


12.6 


52 64 


15.2 


51-65 


15.0 


49-63 


18.5 


44-61 


13.4 


56-68 


n 


7 


13.9 


26-39 


15.7 


37-51 


16.3 


35-50 


12.6 


37-48 


13.7 


30-43 


14.9 


41-55 


7 


6 


9.4 


17-25 


14.5 


22-36 


12.4 


22-34 


16.3 


20-36 


9.4 


21-29 


14.0 


27-40 


6 


5 


67 


09.4-16 


12.7 


08.6-21 


11.3 


09.9-21 


10.7 


08.0-19 


6.8 


13-20 


12.0 


15-26 


5 


A 
M 


5.7 


03 7-093 


6.5 


2-08.4 


7.7 


02.2-09.8 


6.7 


02.2-08.7 


4.7 


08.3-12.9 


7.9 


7-14 


4 


3 


2.5 


01.2-03.6 


1.6 


00.5-01.9 


1.9 


00.3-02.1 


1.7 


00.5-02.1 


2.7 


05.5-08.2 


44 


01.7-6 


3 


2 


0.9 


00.3-01.1 


0.4 


00.0-00.4 


0.2 


00.0-00.2 


0.4 


00.0-00.4 


2.4 


03.1-05.4 


1.4 


00.3-01.6 


2 


1 


0.2 


00.0-00.2 


0.0 


0.0 






0.0 


0.0 


3.0 


00.0-03 


02 


00.0-00.2 


1 




Scaled Score 


Scaled Score 


Scaled Score 


Soiled Score 


Scaled Score 


Scaled 


Score 






Mean - 8.1 
r d Deviation = 245 


Mean - 7.7 
Sid Deviation - 2.45 


Mean .= 7.7 
Std. Deviation = 2.52 


Mean - 7.7 
Sid Deviation = 2.44 


Mean - 7.5 
Std. Deviation ^ 2.49 


Mean - 7.3 
Std. Deviation - ^49 


1 



PERCENTAGES OF MCAT EXAMINEES ACHIEVING SCALED SCORE LEVELS 
AND ASSOCIATED PERCENTILE RANK RANGES BY AREA OF ASSESSMENT 
APRIL 19a» ADMINISTRATION 

N = 17.S02 





Biology 


Chemistry 


Physics 


Science Problems 


Skills Analysis: 
Rtadinfl 


Skills Analysis: 
Ouanlilalive 




Scaled 

Score 


Percent 
Achieving 
Score 


Percentile 
Rank 
Range 


Percent 
Achieving 
Score 


Percentile 
Rank 
Range 


Percent 
Achieving 
Score 


Percentile 
Rank 
Range 


Percent 
Achieving 
Score 


Percentile 
Rank 
Range 


Percent 
Achieving 
Score 


Percentile 
Rank 
Range 


Per'.ont 
Achieving 
Score 


Percentile 
Rank 
Range 


Scaled 
Score 


15 


0.0 


999 


0.1 


99.9 


0.6 


99.5-99.9 


0.5 


99.7-99.9 






0.1 


99.9 


15 


14 


0.1 


99.9 


0.6 


99.9 


1.3 


98.2-99.4 


1.5 


99-996 






0.3 


99.8-99.9 


14 


13 


20 


98-99.9 


3.1 


99.4-99.9 


2.1 


97-98.1 


2.2 


96-98 


0.3 


99.8-99.9 


1.2 


98.6-99.7 


13 


12 


67 


92-97.9 


4.9 


97-99.3 


4.7 


92-96 


4.8 


92-95.9 


2.7 


98-99.7 


3.7 


96-96.5 


12 


11 


10.1 


82-91 


7.2 


92-96 


7.5 


85-91 


5.8 


86-91 


8.4 


90-97 


7.3 


69-95 


11 


10 


15 4 


67-81 


12.7 


85-91 


10.7 


74-84 


11.1 


75-85 


14.5 


75-89 


10.0 


79-88 


10 


9 


15.3 


51-66 


10.9 


72-84 


11.9 


62-73 


12.0 


63-74 


17.6 


58-74 


11.6 


67-78 


9 


8 


13.2 


38-50 


12.7 


62-71 


13.5 


49-61 


14.5 


49-62 


17.2 


40-57 


16.0 


51-66 


8 


7 


11.3 


27^37 


14.2 


49-61 


14.4 


34-46 


14.5 


34-48 


11.6 


29-39 


12.1 


39-50 


7 


6 


9.4 


17-26 


14.5 


35-48 


13.6 


21-33 


14.7 


19 > 


7.3 


21-28 


15.5 


23-36 


6 


5 


7.0 


10-16 


11.2 


20-34 


11.0 


08.9-20 


10.6 


07.3-18 


7.1 


14-20 


10.9 


12-22 


5 


4 


59 


03.7-9 


6.3 


07.9-19 


7.1 


01.8-08.8 


5.7 


02.1-07.8 


5.1 


08.4-13 


6.1 


05.2-11 


4 


3 


2.3 


01.4-036 


1.2 


01.7-07.8 


1.6 


00.2-01.7 


1.6 


00.5-02 


3.5 


5-08.3 


3.5 


01.7-05.1 


3 


c 


1.1 


00.3-01.3 


0.4 


00.5-01.6 


0.1 


00.0-00.1 


0.4 


00.0-00.4 


2.4 


02.6-04.9 


1.2 


00.5-01.6 


d 


1 


0.2 


00.0-00.2 


0.0 


00.0-00.4 










2.5 


00.0-02.5 


0.4 


00.0-00.4 


1 




dcaled Score 


Scaled Score 


Scaled Score 


Scaled Score 


Scaled Score 


Scaled Score 






Mean - 8.2 
Sid Deviation 2.52 


Mean ^ 7.9 
Std Deviation - 2.49 


Mean - 7.9 
Std Deviation ^ 2.55 


Mean ^ 7.9 
Std Deviation 251 


Mean 7.7 
Std Deviation 2.59 


Mean 7.5 
Std Deviation 248 
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CALIFORNIA POSTSECONDARY EDUCATION COMMISSION 



THE California Postsecondary Education Commis- 
sion is a citizen board established in 1974 by the 
Legislature and Governor to coordinate the efforts 
of California's colleges and universities and to pro- 
vide independent, non-partisan policy analysis and 
recommendations to the CSovemor and Legislature. 

Members of the Commission 

The Commission consists of 15 members. Nine rep- 
resent the general public, with three each appointed 
for six-year terms by the Crovernor, the Senate 
Rules Committee, and the Spealcer of the Assembly. 
The other six represent the major segments of post- 
secondary education in California. 

As of February 1990, the Commissioners represent- 
ing the general public are: 

Mim Andelson, Los Angeles; 
C. Thomas Dean, Long Beach; 
Henry Der, San Francisco; 
Seymour M. Farber. M.O., San Francisco; 
Rosalind K. Goddard, Los Angeles; 
Helen Z. Hansen, Long Beach; 
LowellJ. Paige, El Macero; Vice Chair; 
Cruz Reynoso, Los Angeles; Chair; and 
Stephen P. Teale, M.D. , Modesto. 

Representatives of the segments are: 

Meredith J. Khachigian, San Clemente; appointed 
by the Regents of the University of California; 

Theodore J. Saenger, San Francisco; appointed by 
the Trustees of the California State University; 

John F. Parkhurst, Folsom; appointed by the Board 
of Governors of the California Community Colleges; 

Harry Wugalter, Thousand Oaks; appointed by the 
Council for Private Postsecondary Educational In- 
stitutions; 

Joseph D. Carrabino, Orange; appointed by the 
California ?tate Board of Education; and 

James B. Jamieson, San Luis Obispo; appointed by 
the Governor from nominees proposed by Califor- 
nia's independent colleges and universities. 



Functions of the Commission 

The Commission is charged by the Legislature and 
Governor to "assure the effective utilization of pub- 
lic postsecondary education resources, thereby elimi- 
nating waste and unnecessary duplication, and to 
promote diversity, innovation, and responsiveness 
to student and societal needs." 

To this end, the Commission conducts independent 
reviews of matters affecting the 2,600 institutions of 
postsecondary education in California, including 
community colleges, four-year colleges, universi- 
ties, and professional and occupational schools. 

As an advisory planning and coordinating body, the 
Commission does not administer or govern any in- 
stitutions, nor does it approve, authorize, or accredit 
any of them. Instead, it cooperates with other State 
agencies and non-governmental groups that per- 
form these functions, while operating as an indepen- 
dent board with its own staff and its own specific du- 
ties of evaluation, coordination, and planning, 

Operation of the Commission 

The Commission holds regular meetings throughout 
the year at which it debates and takes action on 
staff studies and takes positions on proposed legisla- 
tion affecting education beyond the high school in 
California. By law, its meetings are open to the 
public. Requests to speak at a meeting may be made 
by writing the Commission in advance or by submit- 
ting a request before the start of the meeting. 

The Commission's day-to-day work is carried out by 
its staff in Sacramento, under the guidt nee of its ex- 
ecutive director, Kenneth B. O'Brien, who is ap- 
pointed by the Commission. 

The Commission publishes and distributes without 
charge some 30 to 40 reports each year on major is- 
sues confronting California postsecondary educa- 
tion. Recent reports are listed on the back cover. 

Further information about the Commission, its 
meetings, its staff, and its publications may be ob- 
tained firom the Commission offices at 1020 Twelfth 
Street, Thiru Floor, Sacramento, CA 98614-3985; 
telephone (916) 446-7933. 



STANDARDIZED TESTS USED FOR HIGHER EDUCATION 
ADMISSION AND PLACEMENT IN CALIFORNIA DURING 1989 



California Postsecondary Education Commission Report 90-16 



ONE of a series of reports published by the Commis- 
sion as part of its planning and coordinating respon- 
sibilities. Additional copies may be obtained without 
charge from the Publications Office, California Post- 
secondary Education Commission, Third Floor, 1020 
Twelfth Street, Sacramento, California 96814-3985. 

Recent reports of the Commission include: 

89-28 Funding for ^he California State University's 
Statewide Nursing Program: A Report to the Legis- 
lature in Response to Supplemental Language to the 
1988*89 Budget Act (October 1989) 

89-29 First Progress Report on the Effectiveness of 
Intersegmental Student Preparation Programs: One 
of Three Reports to the Legislature in Response to 
Item 6420-0011-001 of the 1988-89 Budget Act (Octo- 
ber 1989) 

89-30 Evaluation of the Junior MESA Program: A 
Report to the Legislature in Response to Assembly 
Bill 610 (Hughes) of 1985 (October 1989) 

89-31 Legislation Affecting Higher Education Dur- 
ing the First Yea^^ of the 1989-90 Session: A Staff Re- 
port of the California Postsecondary Education Com- 
mission (October 1989) 

89- 32 California Colleges and Universities, 1990: A 
Guide to Degree-Granting Institutions and to Their 
Degree and Certificate Programs (December 1989) 

90- 1 Higher Education at the Crossroads: Planning 
for the Twenty-First Century (January 1990) 

90-2 Technical Background Papers to Higher Edu- 
cation at the Cras$roa(U: Planning for the Twenty- 
First Century (January 1990) 

90-3 A Capacity for Learning: Revising Space and 
Utilization Standards for California Public Higher 
Education (January 1990) 

90-4 Survey of Space and Utilization Standards and 
Guidelines in the Fifty States: A Report of mgt Con- 
sultants, Inc., Prepared for and Published by the Cali- 
fornia Postsecondary Education Commission (Jan- 
uary 1990) 

90-6 Calculation of Base Factors for Comparison In- 
stitutions and Study Survey Instruments: Technical 
Appendix to Survey of Space and Utilization Stan- 
darde and Guiaelines in the Fifty States. A Second 
Report of MOT Consultants, Inc., Prepared for and 
Published by the California Postsecondary Education 
Commission (January 1990) 
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90-6 Final Report, Study of Higher Education Space 
and Utilization Standards/Guidelines in California: 
A Third Report of MOT Consultants, Inc., Prepared for 
and Published by the California Postsecondary Edu- 
cation Commission (January 1990) 

90-7 Legislative Priorities of the Commission, 1990: 
A Report of the California Postsecondary Education 
Commission (January 1990) 

90-8 State Budget Priorities of the Commission, 
1990: A Report of the California Postsecondary Edu- 
cation Commission (January 1990) 

90-9 Guidelines for Review of Proposed Campuses 
and Off-Campus Centers: A Revision of the Commis- 
sion's 1982 Guidelines and Procedures for Review of 
New Campuses and Off-Campus Centers (January 
1990) 

90-10 Faculty Salaries in California's Public Uni- 
versities, 1990-91: A Report to the Legislature and 
Governor in Response to Senate Concurrent Resolu- 
tion No. 51 (1965) (March 1990) 

90-11 Status Report on Human Corps Activities, 
1990: The Third in a Series of Five Annual Reports to 
the Legislature in Response to Assembly Bill 1820 
(Chapter 1245, Statutes of 1987) (March 1990) 

90-12 The Dynamics of Postsecondary Expansion 
in the 1990s: Report of the Executive Director, Ken- 
neth B. O'Brien, March 5, 1990 (March 1990) 

90-13 Analysis of the 1990-91 Governor's Budget: 
A Staff Report to the California Postsecondary Edu- 
cation Commission (March 1990) 

90-14 Comments on the California Community Col- 
leges' 1989 Study of Students with Learning Disabil- 
ities: A Second Report to the Legislature in Response 
to Supplemental Report Language to the 1988 State 
Budget Act (April 1990) 

9045 Services for Students with Disabilities in 
California Public Higher Education, 1990: The First 
in a Series of Biennial Reports to the (Governor and 
Legislature in Response to Assembly Bill 746 (Chap- 
ter 829, Statutes of 1987) (April 1990) 

90-16 Standardized Tests Used for Higher Educa- 
tion Admission and Placement in California During 
1989: The First in a Series of Biennial Reports Pub- 
lished in Accordance with Senate Bill 1416 (Chapter 
446, Statutes of 1989) (April 1990) 
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